Enterprise Data Management Client - 1.5 year ongoing engagement
Languages
Javascript, Python, SQL, R
Fig. 1 — TalkSchema Data Suite featured view (click to expand)
01
The Problem
Business Impact
The client needed to ingest, manipulate, query, and generate reports on datasets with billions of rows - across any file format, including FTP sources. No existing tool handled all these requirements.
Constraints
Running user-submitted SQL/Python/R on shared infrastructure required strict sandboxing - code had to be sanitized and restricted to user-owned resources only.
02
Technical Execution
Architectural Strategy
Built TalkSchema - a modular data management platform with a hierarchical data layer (Datacloud > Database > Datatable > Schema) supporting all manipulation modes.
Depth of Execution
Hierarchical data layer with spreadsheet-like editing, direct SQL access, and custom script actions. Background job scheduler via Celery with live WebSocket streaming of job progress. OpenSearch indexing for fast querying of billions of rows. Each job composed of discrete actions with cancellation, scheduling, and detailed logging. Report module with customizable layouts, PDF/Excel export, and sharable links.
03
Results
✓Billions of records processed reliably across multiple enterprise clients.
✓Background jobs run and schedule autonomously without UI dependency.
✓OpenSearch enables sub-second querying across massive datasets.
Future Proofing
Modular architecture with over 12 modules, each with hundreds of features, built incrementally over 1.5 years.
Project Gallery
04
Client Feedback
"Excellent communication and technical skills. Will definitely use Adarsh again for future projects."
