Data Dictionary

8min

Overview
This data dictionary shows all available data points, explains their values, and provides raw job posting data samples.
All tables have snippets of the Professional Network Job Postings dataset.
All personal/company information mentioned within this context is entirely fictional and is solely intended for illustrative purposes.
Updated tables
﻿Main job posting information﻿
﻿Functions﻿
﻿Industries 
﻿
Data points
Job posting information
Data point
Description
Data type
Example values
id
Identification key for a job posting record

Each record in the dataset has its ID value

ID in the job table becomes job_id later in the other tables of the dataset
number (integer)
204184
job_id
Job posting record ID assigned in the database
number (integer)
117902
created
The time and date when we first scraped the record
string
2019-12-07 22:07:18
last_updated
The time and date when we last scraped the record
string
2020-09-06 04:51:48
deleted
One of two values - 1 or 0
1 - the last time we scraped the job posting profile
0 - job posting was successfully scraped

Note: we revisit and rescrape job postings with deleted = 0 flags, as they are still active.
boolean
deleted: 0
Data point
Description
Data type
time_posted
Job ad publish date (as displayed on the professional network)
String
title
Job title
String
description
Job description
Note: contains control characters.
String
seniority
Seniority level
String
employment_type
Full-time or part-time work
String
location
Job location
String
url
Job posting URL
String
hash
Job posting URL, processed by the MD5 algorithm
String
company_id
Company identification key, relating directly to the company table
Integer
company_name
Company name
String
company_url
Company profile URL
String
external_url
External URL provided by the company referring to the job posting
String
application_active
One of two values possible - 1 or 0.

0 - the last time we scraped the job posting, the job posting was deactivated.
1 - the last time we scraped the job posting, it was still active
Boolean
salary
Offered salary 
String
applicants_count
Number of applicants
String
professional_network_job_id
Job identifier on the professional network
Integer
country
Job location (country)
String
last_updated_ux
Unix timestamp of the last record update
Integer
redirected_url
URL where we are redirected while trying to access the job posting 
String
redirected_url_hash
Redirected URL processed by the MD5 algorithm
String
The main job table data sample:
Main job table
  {
    "id": 6946,
    "created": "2020-08-21 11:16:17",
    "last_updated": "2021-02-24 22:30:06",
    "time_posted": "6 months ago",
    "title": "Energy Procurement Negotiator",
    "description": "Responsibilities will include:   ·        Produce tenders and issue them to suppliers within appropriate deadlines ·        Initiate price and contract term negotiations with suppliers ·        Ensure contract recommendations are accurate and sent out in a timely manner ·        Enter manual and electronic offers accurately, to create like-for-like cost analysis ·        Working closely with other teams and supporting the wider busines with knowledge of energy contracting and pricing ·        Issuing recommendations to clients via e-mail, and following-up via telephone ·        Processing of acceptances ·        Ensuring system details are maintained and updated accurately ·        Develop networks and relationships with energy supplier contacts ·        Ensure tender fees are invoiced upon completion of work ·        Ongoing contract management and resolution of client queries",
    "seniority": "Associate",
    "employment_type": "Full-time",
    "location": "Owlsmoor, England, United Kingdom",
    "url": "https://www.professional-network.com/jobs/view/energy-procurement-negotiator-at-energy-company-2002092926",
    "hash": "e9dccd36998f1c4a341fc1e234f57a2e",
    "company_id": 23087523,
    "company_name": "Energy company",
    "company_url": "https://www.professional-network.com/company/energy-company",
    "external_url": null,
    "deleted": 1,
    "application_active": 0,
    "salary": "£23,000.00 - £28,000.00",
    "applicants_count": "55 applicants",
    "professional-network_job_id": 2002092926,
    "country": "United Kingdom",
    "last_updated_ux": 1614205806,
    "redirected_url": "https://www.professional-network.com/jobs/view/energy-procurement-negotiator-at-energy-company-2002092926",
    "redirected_url_hash": "e9dccd36998f1c4a341fc1e234f57a2e",
  {
    "id": 6946,
    "created": "2020-08-21 11:16:17",
    "last_updated": "2021-02-24 22:30:06",
    "time_posted": "6 months ago",
    "title": "Energy Procurement Negotiator",
    "description": "Responsibilities will include:   ·        Produce tenders and issue them to suppliers within appropriate deadlines ·        Initiate price and contract term negotiations with suppliers ·        Ensure contract recommendations are accurate and sent out in a timely manner ·        Enter manual and electronic offers accurately, to create like-for-like cost analysis ·        Working closely with other teams and supporting the wider busines with knowledge of energy contracting and pricing ·        Issuing recommendations to clients via e-mail, and following-up via telephone ·        Processing of acceptances ·        Ensuring system details are maintained and updated accurately ·        Develop networks and relationships with energy supplier contacts ·        Ensure tender fees are invoiced upon completion of work ·        Ongoing contract management and resolution of client queries",
    "seniority": "Associate",
    "employment_type": "Full-time",
    "location": "Owlsmoor, England, United Kingdom",
    "url": "https://www.professional-network.com/jobs/view/energy-procurement-negotiator-at-energy-company-2002092926",
    "hash": "e9dccd36998f1c4a341fc1e234f57a2e",
    "company_id": 23087523,
    "company_name": "Energy company",
    "company_url": "https://www.professional-network.com/company/energy-company",
    "external_url": null,
    "deleted": 1,
    "application_active": 0,
    "salary": "£23,000.00 - £28,000.00",
    "applicants_count": "55 applicants",
    "professional-network_job_id": 2002092926,
    "country": "United Kingdom",
    "last_updated_ux": 1614205806,
    "redirected_url": "https://www.professional-network.com/jobs/view/energy-procurement-negotiator-at-energy-company-2002092926",
    "redirected_url_hash": "e9dccd36998f1c4a341fc1e234f57a2e",
﻿
Functions
Data point
Description
Data type
Example values
id
Record identification key 
number (integer)
204184
job_id
Job posting record ID assigned in the database
number (integer)
117902
created
The time and date when we first scraped the record
string
2019-12-07 22:07:18
last_updated
The time and date when we last scraped the record
string
2020-09-06 04:51:48
deleted
One of two values - 1 or 0
1 - the last time we scraped the job posting profile
0 - job posting was successfully scraped

Note: we revisit and rescrape job postings with deleted = 0 flags, as they are still active.
boolean
deleted: 0
Data point
Description
Data type
job_functions_collection
Consists of record metadata and job_function_list objects
Array of objects
function_id
Identification key relating to the job_function_list table
Integer
job_function_list
Information on the job functions in the job ad
Object
function
Job function title
String
hash
Job function title processed by the MD5 algorithm
String
Job functions table data sample:
Job functions
 "job_functions_collection": [
      {
        "id": 11853,
        "job_id": 6946,
        "function_id": 10,
        "deleted": 1,
        "created": "2020-08-21 11:16:17",
        "last_updated": "2020-12-18 09:55:00",
        "job_function_list": {
          "id": 10,
          "created": "2020-08-14 14:11:38",
          "last_updated": "2020-08-14 14:11:38",
          "function": "General Business",
          "hash": "90cfa53847d7670be539c44ee419364d"
        }
      }
   ],
 "job_functions_collection": [
      {
        "id": 11853,
        "job_id": 6946,
        "function_id": 10,
        "deleted": 1,
        "created": "2020-08-21 11:16:17",
        "last_updated": "2020-12-18 09:55:00",
        "job_function_list": {
          "id": 10,
          "created": "2020-08-14 14:11:38",
          "last_updated": "2020-08-14 14:11:38",
          "function": "General Business",
          "hash": "90cfa53847d7670be539c44ee419364d"
        }
      }
   ],
﻿
Industries
Data point
Description
Data type
Example values
id
Record identification key 
number (integer)
204184
job_id
Job posting record ID assigned in the database
number (integer)
117902
created
The time and date when we first scraped the record
string
2019-12-07 22:07:18
last_updated
The time and date when we last scraped the record
string
2020-09-06 04:51:48
deleted
One of two values - 1 or 0
1 - the last time we scraped the job posting profile
0 - job posting was successfully scraped

Note: we revisit and rescrape job postings with deleted = 0 flags, as they are still active.
boolean
deleted: 0
Data point
Description
Data type
job_industries_collection
Consists of record metadata and job_industry_list objects
Array of objects
industry_id
Identification key relating to the job_industry_list table
Integer
job_industry_list
Contains information on the job industry
Object
industry
Job industry title
String
hash
Job industry title processed by the MD5 algorithm
String
Industries table data sample:
Industries
 "job_industries_collection": [
      {
        "id": 15821,
        "job_id": 6946,
        "industry_id": 47,
        "deleted": 0,
        "created": "2020-08-21 11:16:17",
        "last_updated": "2020-12-18 10:15:45",
        "job_industry_list": {
          "id": 47,
          "created": "2020-08-14 14:11:53",
          "last_updated": "2020-08-14 14:11:53",
          "industry": "Oil & Energy",
          "hash": "66c19aa77111f14ce7e7658269459917"
        }
      }
  ]
 "job_industries_collection": [
      {
        "id": 15821,
        "job_id": 6946,
        "industry_id": 47,
        "deleted": 0,
        "created": "2020-08-21 11:16:17",
        "last_updated": "2020-12-18 10:15:45",
        "job_industry_list": {
          "id": 47,
          "created": "2020-08-14 14:11:53",
          "last_updated": "2020-08-14 14:11:53",
          "industry": "Oil & Energy",
          "hash": "66c19aa77111f14ce7e7658269459917"
        }
      }
  ]
﻿
﻿

Data point	Description	Data type	Example values
id	Identification key for a job posting record Each record in the dataset has its ID value ID in the job table becomes job_id later in the other tables of the dataset	number (integer)	204184
job_id	Job posting record ID assigned in the database	number (integer)	117902
created	The time and date when we first scraped the record	string	2019-12-07 22:07:18
last_updated	The time and date when we last scraped the record	string	2020-09-06 04:51:48
deleted	One of two values - 1 or 0 1 - the last time we scraped the job posting profile 0 - job posting was successfully scraped Note: we revisit and rescrape job postings with deleted = 0 flags, as they are still active.	boolean	deleted: 0

Data point	Description	Data type
time_posted	Job ad publish date (as displayed on the professional network)	String
title	Job title	String
description	Job description Note: contains control characters.	String
seniority	Seniority level	String
employment_type	Full-time or part-time work	String
location	Job location	String
url	Job posting URL	String
hash	Job posting URL, processed by the MD5 algorithm	String
company_id	Company identification key, relating directly to the company table	Integer
company_name	Company name	String
company_url	Company profile URL	String
external_url	External URL provided by the company referring to the job posting	String
application_active	One of two values possible - 1 or 0. 0 - the last time we scraped the job posting, the job posting was deactivated. 1 - the last time we scraped the job posting, it was still active	Boolean
salary	Offered salary	String
applicants_count	Number of applicants	String
professional_network_job_id	Job identifier on the professional network	Integer
country	Job location (country)	String
last_updated_ux	Unix timestamp of the last record update	Integer
redirected_url	URL where we are redirected while trying to access the job posting	String
redirected_url_hash	Redirected URL processed by the MD5 algorithm	String

Data point	Description	Data type	Example values
id	Record identification key	number (integer)	204184
job_id	Job posting record ID assigned in the database	number (integer)	117902
created	The time and date when we first scraped the record	string	2019-12-07 22:07:18
last_updated	The time and date when we last scraped the record	string	2020-09-06 04:51:48
deleted	One of two values - 1 or 0 1 - the last time we scraped the job posting profile 0 - job posting was successfully scraped Note: we revisit and rescrape job postings with deleted = 0 flags, as they are still active.	boolean	deleted: 0

Data point	Description	Data type
job_functions_collection	Consists of record metadata and job_function_list objects	Array of objects
function_id	Identification key relating to the job_function_list table	Integer
job_function_list	Information on the job functions in the job ad	Object
function	Job function title	String
hash	Job function title processed by the MD5 algorithm	String

Data point	Description	Data type	Example values
id	Record identification key	number (integer)	204184
job_id	Job posting record ID assigned in the database	number (integer)	117902
created	The time and date when we first scraped the record	string	2019-12-07 22:07:18
last_updated	The time and date when we last scraped the record	string	2020-09-06 04:51:48
deleted	One of two values - 1 or 0 1 - the last time we scraped the job posting profile 0 - job posting was successfully scraped Note: we revisit and rescrape job postings with deleted = 0 flags, as they are still active.	boolean	deleted: 0

Data point	Description	Data type
job_industries_collection	Consists of record metadata and job_industry_list objects	Array of objects
industry_id	Identification key relating to the job_industry_list table	Integer
job_industry_list	Contains information on the job industry	Object
industry	Job industry title	String
hash	Job industry title processed by the MD5 algorithm	String

Updated 02 Jul 2024

Did this page help you?

Professional Network: Jobs

Data Sample

Data Dictionary

Overview

Data index

Data points

Job posting information

Repeat fields

Functions

Repeat fields

Industries

Repeat fields