Bulk Collect: Base Jobs API

Overview

Discover the Bulk Collect (Bulk API) capabilities and explore potential uses for efficiently retrieving deduplicated, globally sourced jobs data in batches. Find all Bulk Collect related information in the following topic:

General information about Bulk Collect

Endpoints

Bulk Collect is an extension of Base Jobs API and consists of two POST and two GET endpoints.

Collect job posting data in bulk using a job posting ID list or search filters.

Request type	Endpoint
POST	/v2/data_requests/job_base/id_file
POST	/v2/data_requests/job_base/filter
GET	/v2/data_requests/{data_request_id}/files
GET	/v2/data_requests/{data_request_id}/files/{file_name}

Limiting returned record count

Include the parameter "limit": int to control the number of records returned by your queries.

This parameter is entirely optional. However, use it to make sure you don't use too many credits with your Bulk Collect queries.

Request example to retrieve five records The example scopes to a one-week window to keep the result set small – in production, created_at filters can span the full archive from August 2020, and last_updated filters are recommended for pipelines tracking fresh postings, as active jobs are revisited within 24 hours.

Filters

curl -X 'POST' \
  'https://api.coresignal.com/cdapi/v2/data_requests/job_base/filter' \
  -H 'accept: application/json' \
  -H 'apikey: {API Key}' \
  -H 'Content-Type: application/json' \
  -d '{
    "webhook_url": "{optional_webhook_url}",
    "limit": 5,
    "filters": {
        "created_at_gte": "2023-05-01 00:00:01",
        "created_at_lte": "2023-05-07 00:00:01",
        "company_professional_network_url": "https://www.professional-network.com/company/thermo-fisher-scientific"
    }
}'

Credits

Your credits for Base Jobs API will also apply to Bulk Collect data collection requests.

Learn about the credits in Bulk Collect usage in the general Bulk Collect topic.

Rate limits

Bulk Collect endpoints have a limited number of requests allowed per second. Learn about rate limits for Bulk Collect requests.

Webhooks

POST endpoints allow you to add webhooks and get notified when your data request is ready.

Keep in mind that webhook_url is optional.

Search filter template

Search filter template

{
  "webhook_url": "{optional_webhook_url}",
  "filters": {}
}

ID file cURL template

ID file cURL template

curl -X 'POST' \
  'https://api.coresignal.com/cdapi/v2/data_requests/job_base/id_file' \
  -H 'accept: application/json' \
  -H 'apikey: {API Key}' \
  -H 'Content-Type: multipart/form-data' \
  -F 'ids_file=@id_list_example.csv;type=text/csv' \
  -F 'webhook_url={optional_webhook_url}'