...
To support auto-scaling of the system resources to adapt to the load of external requests to the Brown Dog Data Tiling Service. In general, this includes Medici, MongoDB, RabbitMQ, and the extractors. Currently the design focuses only on auto-scaling the extractors. Specifically, the system needs to start or use more extractors when a certain criterion is met , (such as the number of outstanding requests exceeds a certain threshold) – scaling up, and suspend or stop extractors when other criteria are met – scaling down. The intention purpose of the scaling down part is to save system resources (CPU, memory, etc.) for other purposesuses.
- Investigated technologies
- Olive (olivearchive.org): mainly developed at Carnegie Mellon University (CMU).
Three main ideas: Internet Suspend/Resume (allow a user to start using a VM before it its entire image is fully downloaded), indexing and searching of VM images, incrementally composing VM images. The last 2 3rd and part of the 2nd have been done in Docker.
Impression: seems to be academic quality, ; the feature and quality do not seem a good fit for the Brown Dog project.
- OpenVZ (openvz.org): a community project, supported by the company Parallels, Inc. An OS-level virtualization technology based on the Linux kernel.
...