Skip to content

Latest commit

 

History

History
89 lines (69 loc) · 2.25 KB

updating_data.md

File metadata and controls

89 lines (69 loc) · 2.25 KB
Raw

CALC Data Imports

About the data

https://github.com/18F/calc/tree/master/contracts/docs has all versions of the data that has been imported to date. https://github.com/18F/calc/blob/master/contracts/docs/hourly_prices.csv is the most recent data set.

The files that we get are in .xlsx format. They need to be converted to CSV. The columns should be arranged as such:

  • Labor Category
  • Year 1 or base rate
  • Year 2 rate
  • Year 3 rate
  • Year 4 rate
  • Year 5 rate
  • Education level
  • Minimum years of experience
  • Business Size
  • Location
  • Company Name
  • Contract number
  • Schedule
  • SIN number
  • Current contract year
  • Contract begin date
  • Contract end date
Labor Category

Ex: "Mechanical Engineer". Cannot be empty.

Contract Year Rates 1-5

Ex: 253.88. The first year cannot be empty.

Education Level

Must be one of the following or empty:

  • "High School"
  • "Associates"
  • "Bachelors"
  • "Masters"
  • "Ph.D"
Minimum Years of Experience

Must be an integer or empty.

Business Size

Must be one of the following or empty:

  • "s" for small business
  • "o" for other than small
Worksite Location

Must be one of the following or empty:

  • "customer"
  • "contractor"
  • "both"
Company Name

Ex: "Great Products Inc." Must not be empty.

Contract ID

Ex: "GS-10F-0616P" Must not be empty.

Schedule Name

Must be one of the following or empty:

  • AIMS
  • Consolidated
  • Environmental
  • Logistics
  • Language Services
  • MOBIS
  • PES
SIN Number

Ex: "235-34" or "235-34, 689-12".

Current Contract Year

Must be an integer from 1-5. Cannot be empty.

Contract Start Date and Contract End Date

Month/Day/Year Ex: "12/3/14"

Updating the contract data

Save a copy of the CSV as the next version of the data in https://github.com/18F/calc/tree/master/contracts/docs. Overwrite hourly_prices.csv with the new file.

Run ./manage.py load_data

This will replace all existing records with the ones in the CSV.

Should the format of the file we import ever change, run ./manage.py makemigrations and alert the team that they will need to run migrations on their local environments.

Updating data on Cloud Foundry

Before pushing to an app, edit the manifest.yml and under the environment you want to push to, add command: bash cf.sh.