Skip to content
Snippets Groups Projects
Commit 7cd13d64 authored by Haoran Qiu's avatar Haoran Qiu
Browse files

update

parent cb25bebe
No related branches found
No related tags found
No related merge requests found
# AWARE # AWARE
AWARE is an extensible framework for deploying and managing RL(reinforcement learning)-based agents in production systems. AWARE is an extensible framework for deploying and managing RL (reinforcement learning)-based agents in production systems.
AWARE provides (1) fast adaptation with meta-learning, (2) reliable RL exploration with bootstrapping, (3) timely retraining by continuous monitoring. AWARE provides (1) fast adaptation with meta-learning, (2) reliable RL exploration with bootstrapping, (3) timely retraining by continuous monitoring.
## Requirements ## Requirements
...@@ -46,7 +46,6 @@ aware/ ...@@ -46,7 +46,6 @@ aware/
``` ```
## Testing ## Testing
### Functionality
Start training with meta-learner, with model checkpoints saved to `testing/checkpoints/`. Start training with meta-learner, with model checkpoints saved to `testing/checkpoints/`.
...@@ -79,6 +78,21 @@ The number of episodes is set to 500 for demonstration purpose. ...@@ -79,6 +78,21 @@ The number of episodes is set to 500 for demonstration purpose.
For running AWARE (training and policy-serving) with application `deployment` managed by RL-based MPA in Kubernetes cluster, follow `multidimensional-pod-autoscaler/README.md` to deploy MPA and `rl-controller/README.md` for training and customizing for application deployments from scratch. For running AWARE (training and policy-serving) with application `deployment` managed by RL-based MPA in Kubernetes cluster, follow `multidimensional-pod-autoscaler/README.md` to deploy MPA and `rl-controller/README.md` for training and customizing for application deployments from scratch.
## Reference
```
@inproceedings {qiu2023aware,
author = {Qiu, Haoran and Mao, Weichao and Wang, Chen and Franke, Hubertus and Kalbarczyk, Zbigniew T. and Ba\c{s}ar, Tamer and Iyer, Ravishankar K.},
title = {{AWARE}: Automate Workload Autoscaling with Reinforcement Learning in Production Cloud Systems},
booktitle = {2023 USENIX Annual Technical Conference (USENIX ATC 23)},
year = {2023},
address = {Boston, MA},
pages = {1--17},
publisher = {USENIX Association},
month = jul,
}
```
## Contact ## Contact
Haoran Qiu (haoranq4@illinois.edu) Haoran Qiu (haoranq4@illinois.edu)
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment