Maxwell — ML Data Pipelines
Data Engineering
PythonPandasNumPyNumbaRAPIDSDaskApache ArrowApache ParquetNVIDIA CUDA
Custom libraries for acquisition, preparation, and storage of financial market data — WebSockets/REST connectors, anomaly detection across hundreds of millions of data points, and domain-specific feature engineering.
Maxwell processed 20+ years of trading and order-book market data at multiple time resolutions from high-volume real-time market APIs, accelerating storage and retrieval with Apache Arrow in-memory columnar formats and Apache Parquet persistent on-disk storage.
Key capabilities:
- Automated labeling of time-series data with algorithmic trading attributes — stop losses, long/short price targets, ATR, VWAP
- Feature engineering with binning, one-hot encoding, scaling, and normalization tuned for market microstructure data
- GPU-accelerated (CUDA) processing with Dask and RAPIDS for hundreds of millions of data points