← Back to selected work

Nightly Market Data

DATA / AUTOMATION / CASE STUDY

The market closes. The pipeline clocks in.

The problem

Daily NSE Bhavcopy files needed to reach a queryable database without a manual nightly download.

The approach

Set up a cron-based ingestion pipeline that downloads daily market files, parses their contents, and loads them into PostgreSQL.

How the system connects

  1. 01Nightly cron
  2. 02Bhavcopy download
  3. 03Parse daily files
  4. 04PostgreSQL load

Technology

PythonCron JobsPostgreSQLLinuxSQL

Outcome & next steps

A nightly ingestion workflow for daily market data.

Built at Prishitech Solutions · Sep 2025–present.

Discuss a similar project ↗