🏛️ Admin: Architecture & Big Tech Aggregation
How we ingest career boards from Palantir, Microsoft, Apple, Google, Meta, and JobServe.
🔄 Ingestion Pipeline Overview
+-----------------------------------------------------------------------------------+
| Cloudflare Edge Isolate Runtime |
| |
| [ Enterprise Job Endpoints ] |
| ├── 1. Palantir (Greenhouse ATS) ──> [ Ingestion Adapter ] ─┐ |
| ├── 2. Microsoft Careers API ──> [ JSON Transformer ] ──┼─> [ Normalizer]|
| ├── 3. Apple Jobs API ──> [ ML/AI Parser ] ──┤ │ |
| ├── 4. Google DeepMind Careers ──> [ Google API v3 ] ──┤ │ |
| ├── 5. Meta Careers (Llama/FAIR) ──> [ FAIR Adapter ] ──┤ │ |
| └── 6. JobServe / Remotive ──> [ RSS / HTML Parser ] ──┘ │ |
| v |
| [ Edge In-Memory Unified Store ] |
| │ |
| ┌─────────────────────────────────────────────────────┴──┐ |
| v v |
| [ Web UI & Big Tech Hub (/big-tech) ] [ Azure Blob Storage ] |
| [ JSON API (/api/big-tech, /api/jobs) ] [ (1 Write Per Day) ] |
+-----------------------------------------------------------------------------------+🔌 Active Ingestion Sources
| Source Name | Adapter Type | Target Endpoint | Status |
|---|---|---|---|
| Palantir Careers (Greenhouse) | Direct ATS Ingestion | https://boards-api.greenhouse.io/v1/boards/palantir/jobs | Active |
| Microsoft Careers API | JSON Search Endpoint | https://gcsservices.careers.microsoft.com/search/api/v1/search?q=AI | Active |
| Apple Jobs API | Direct Job Board API | https://jobs.apple.com/api/v1/search?query=Machine%20Learning | Active |
| Google & DeepMind Careers | Google Careers API v3 | https://careers.google.com/api/v3/search/?q=DeepMind | Active |
| Meta Careers (Llama/FAIR) | Meta Careers REST API | https://www.metacareers.com/api/v1/jobs?query=Llama | Active |
| JobServe (UK/Global) | HTML / RSS Query Scraper | https://www.jobserve.com/gb/en/JobSearch.aspx?q=Forward+Deployed+AI | Active |
| Remotive AI Jobs API | Public JSON REST API | https://remotive.com/api/remote-jobs?category=software-dev&search=AI | Active |