Add Indeed, LinkedIn, Ziprecruiter and make OpenAI cheaper - #1

Open

androng wants to merge 17 commits into

EricTechPro:mainfrom

Commits on Feb 17, 2025

make some file names more clear, add directions, add null checks, remove a bug "jobURL" in the deduplication that made jobs data never match
androng
committed
8bee299
remove stuff from tracking, add more null checks
androng
committed
76aa503
add ability to run the Ziprecruiter Apify Actor multiple times based on multiple input files
androng
committed
a566792

Commits on Feb 18, 2025

Commits on Feb 20, 2025

fix Ziprecruiter scraper incorrect link bug, add error in the spreadsheet in case there is an OpenAI error
androng
committed
2ef3396

Commits on Feb 24, 2025

Added Indeed Apify actor, Add batch processing to process all jobs into OpenAI at once to lower OpenAI bill, converted everything to Typescript so I could use Pqueue to run Apify actors in parallel
androng
committed
6b51568

Commits on Feb 26, 2025

fix a bug where jobs from multiple runs were not deduplicated amonst each other, only deduplicated on jobs from spreadsheet. Fixed another bug where the new file format caused reading from file to …
androng
committed
dba3daa

Commits on Mar 4, 2025

Commits on Mar 8, 2025

Commits on Apr 13, 2025

fix a problem with linkedin URLs
androng
committed
96d46d1