(ICML 2024) Pursuing Overall Welfare in Federated Learning through Sequential Decision Making (https://arxiv.org/abs/2402.14650)
StarCraft II high-level feature extractor and replay visualizer
A project to classification.
The economic value of execution feedback: Bayesian filtering, hidden-regime market making and reproducible joint-belief control.
Sequential finite-population certification on GB1 and AAV2 with complete paired-trial audit artifacts.
Implementation of a Decision Transformer for power-grid control in L2RPN. The model learns from offline Tutor/Junior demonstrations and continues training online, serving as a drop-in replacement for PPO in the original pipeline proposed by aspirin96.
Four policy classes (PFA/CFA/VFA/DLA) on the energy-storage problem, scored against a verified exact optimum, with a model-misspecification study
Reproducible research tools for result-aware decision workflows and conformal reference retention.
Do humans adapt their planning horizon? - An analysis of sequential decision-making in the videogame Frogger
Empirical study of perturbation inflation in linear Thompson Sampling, with a LinearDecayTS schedule and a reproducible 1,800-trial experiment.
A reproducible falsification harness for resource-bounded AI-agent scheduling under correlated failures, noisy verification, costs, deadlines, and false-acceptance constraints.
Researching policy-induced observability in recommender systems: when serving policies create self-confirming preference models, and when exploration is worth the cost.
Risk-based sequential stopping: when to invoke an LLM in streaming systems. Code for ECML PKDD 2026 (Research Track). arXiv:2607.13048 · Zenodo DOI 10.5281/zenodo.20783549
Socially-equitable renewable energy budget allocation MDPs — same solvers compared across a mature economy (8 U.S. cities) and an emerging one (West Java, Indonesia). Code for arXiv:2607.10201
Multi-agent drone search simulation for oil-spill detection under uncertainty.
PyTorch implementation of REACT: longitudinal active feature acquisition with Gumbel-Sigmoid relaxation for cost-aware sequential feature selection with context. ACM BCB 2026.
Testing temporal reasoning in trading agents under random liquidation horizons
Multi-stage Stochastic Programming for Integrated Network Optimization in Hurricane Relief Logistics and Evacuation Planning
Game-tree search (Minimax, MCTS, Descent) with a CNN evaluation function for Othello - MSc thesis code
To associate your repository with the sequential-decision-making topic, visit your repo's landing page and select "manage topics."