Supply Chain RL Environment
I built SupplyChainBench, an RL environment and benchmark designed to test whether LLMs can learn to make better decisions when the consequences of their actions only become visible several steps later. Using the Beer Distribution Game, models must forecast demand, account for orders already in the pipeline, and make decisions whose effects unfold over several weeks. On 16 held-out stochastic benchmark seeds, Qwen3.5-4B scored 38.42 with a GRPO + LoRA adapter versus 11.78 untrained—a 3.3× improvement. The adapter was trained on the earlier environment and evaluated on the stochastic version without retraining.