SYNOPSIS

The open data portals have become a reality for a few years. However, data availability does not completely solve the challenge of their exploitation. The user still has to juggle with a wide range of portals, a lack of data normalization on them regarding data format and/or dataset structure and with short availability through time.

This training will allow participants to become aware of how to exploit such open data, thanks to the development of a tangible exampleshared bike systems in two large french cities (namely, Bordeaux and Lyon). From data gathering to analyze, and even until data restitution onto a web API, this training will illustrate a whole open data exploitation pipeline.

GOALS

Thanks to this training, you will develop the following skills:

  • Know how to get an open dataset on a public portal
  • Request a database from Python
  • Do a simple statistic analysis
  • Share its result through a web API

PROGRAM

This program is indicative. It could be adapted to your specific needs.

  • Data extraction from public open data portals
    • Discovering Bordeaux and Lyon open data portals
    • Get a simple dataset from data portals (shared bike availability)
    • Put bike data in database
    • In-base dataset handling wiwth psql (PostgreSQL)
    • Dataset handling with Python
    • Get the data automatically with a CRON job
  • Statistical analysis of shared bike availability
    • Data description: elementary statistics
    • Feature extraction: how to create additional information
    • Shared-bike station classification starting from their availability profile
    • Short-term bike availability prediction
  • Data visualization
    • Plotting geo-referenced data in QGIS
    • Build a simple web API to visualize in-base data

DURATION

3 days

PRE-REQUISITE

  • Ease in Python programming language
  • Knowledges in databases and SQL language
  • Knowledge about most common data formats (csvjson)
  • Notions about web programming (scrapping, API conception)

The next courses (Lyon or Paris):

.

Contact us for on-site trainings (dates are flexible to your needs).

You want to participate in this training ?

Please give us the details below if you can:

* Training

Place of training, Number of people involved, Initial level of participants, Time constraints, Specific expectations

* Contact details

Organization, Address, Contact, Email, Intracommunity VAT