简体   繁体   中英

Mesos implementation

I have two Django websites that create a Spark Session to a Cluster which is running on Mesos.

The problem is that whatever Django starts first will create a framework and take 100% the resources permanently, it grabs them and doesn't let them go even if idle.

I am lost on how to make the two frameworks use only the neede resources and have them concurrently access the Spark cluster.

Looked into spark schedulres, dynamic resources for spark and mesos but nothing seems to work. Is it even possible or should I change the approach?

Self solved using dynamic allocation.

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM