Bulk Collect

Overview

Discover the Bulk Collect (Bulk API) capabilities and explore potential uses for efficiently retrieving jobs data in batches. Find all Bulk Collect related information in the following topic:

General information about Bulk Collect

Endpoints

Bulk Collect is an extension of Base Jobs API and consists of two POST and two GET endpoints.

Collect job posting data in bulk using a job posting ID list or search filters.

Request type	Endpoint
POST	/v2/data_requests/job_base/id_file
POST	/v2/data_requests/job_base/filter
GET	/v2/data_requests/{data_request_id}/files
GET	/v2/data_requests/{data_request_id}/files/{file_name}

Limiting returned record count

Include the parameter "limit": int to control the number of records returned by your queries.

This parameter is entirely optional; however, use it to make sure you don't use too many credits with your Bulk Collect queries.

Request example to retrieve five records

Filters

curl -X 'POST' \
  'https://api.coresignal.com/cdapi/v2/data_requests/job_base/filter' \
  -H 'accept: application/json' \
  -H 'apikey: {API Key}' \
  -H 'Content-Type: application/json' \
  -d '{
    "webhook_url": "{optional_webhook_url}",
    "limit": 5,
    "filters": {
        "created_at_gte": "2023-05-01 00:00:01",
        "created_at_lte": "2023-05-07 00:00:01",
        "company_professional_network_url": "https://www.professional-network.com/company/thermo-fisher-scientific"
    }
}'

Credits

Your credits for Base Jobs API will also apply to Bulk Collect data collection requests.

Learn about the credits in Bulk Collect usage in the general Bulk Collect topic.

Rate limits

Bulk Collect endpoints have limited requests allowed per second. Learn about credits in Bulk Collect usage in the main Base Jobs API topic.

Webhooks

POST endpoints allow you to add webhooks and get notified when your data request is ready.

Keep in mind that webhook_url is optional.

Search filter template

Search filter template

{
  "webhook_url": "{optional_webhook_url}",
  "filters": {}
}

ID file cURL template

ID file cURL template

curl -X 'POST' \
  'https://api.coresignal.com/cdapi/v2/data_requests/job_base/id_file' \
  -H 'accept: application/json' \
  -H 'apikey: {API Key}' \
  -H 'Content-Type: multipart/form-data' \
  -F 'ids_file=@id_list_example.csv;type=text/csv' \
  -F 'webhook_url={optional_webhook_url}'