My first high-frequency trading project using machine learning (LightGBM + CNN + Transformer), which is part of my initial research.
I used 1 month length of 1 second high-frequency ES futures data with 15 levels of order book each side to train and test the model. PCA and supervised autoencoder are used in dimensionality reduction, and Lightgbm with hyperparameters tuning using optuna and Transformer are used for predicting the mid-price movement.
Backtrader is used in the final stage to backtest the model.
HFT_Project 1 and 2 use LightGBM with different settings of features
HFT_Project_deeplearning_transformer uses CNN to extract order book features from 15 levels of orderbook data and a transformer for forecasting.

