1,236 questions
Score of 2
1 answer
87 views
Customized executor in Mesos does not work
I am trying to implement a customized executor in Mesos which is the simplest example, but it seems the process being launched gets killed by the Mesos agent.
The error information:
I0103 16:46:27....
Score of 1
0 answers
41 views
How to run a local python script with spark on mesos in cluster mode
I want to run a local python script with spark on mesos.
My master use a mesos dispatcher to install a spark framework.
./start-mesos-dispatcher.sh --master mesos://master:5050
Then I use spark-...
Score of 2
1 answer
343 views
Failed to find a mounted cgroups hierarchy for the 'cpu' subsystem; you probably need to mount cgroups manually on MacOS Sonoma 14.3.1
I am trying to run a mesos-slave container on MacOS with an ARM64 architecture. Since there is no native ARM64 Docker image for mesos-slave on dockerhub, I have to build my image with a base centos7 ...
Score of 0
1 answer
58 views
deregistered instance showing unreachable in mesos , how to clear this?
i am using mesos-marathon cluster for my setup and i have 40 instances registered with mesos .
i want to remove 1 instance from the cluster. To do that , i just stopped that ec2 instance and reduce ...
Score of 1
1 answer
641 views
Configuring a self hosted GitLab-CE CI/CD server in parallel with a GitHub Team account
I am looking to perform code reviews as part of a trunk based development approach with my backend team on a self hosted gitlab server. I also wish to use it to deploy to internally hosted ...
Score of 0
1 answer
85 views
How to set log level in chronos
I'm trying to change the loglevel in chronos from the default INFO to TRACE. I have gone through the docs and they seem to be outdated as per this issue.
I have done a local setup using docker but to ...
Score of 0
0 answers
152 views
configure: error: Mesos requires Python < 3.0
I want to install Mesos on Oracle Linux 8.3 which does not have Internet access. I followed the process exactly in its site in part CentOS 7.1 and installed some packages before building mesos. I ...
Score of 1
0 answers
2207 views
Exception in thread "main" org.apache.spark.SparkException: Driver cores must be a positive number
I have problem with submit task in Mesos with cluster mode, first I using this syntax to running cluster mode on Mesos
$ cd spark
$ ./sbin/start-mesos-dispatcher.sh --master mesos://10.2.3.95:5050
...
Score of 0
0 answers
76 views
Task/Job Failed on Mesos
enter image description here
Anyone know why every task/job that I run using spark submit on my apache Mesos cluster is always STATE FAILED? For your information, I using spark mesos dispatcher to run ...
Score of 0
1 answer
84 views
Integrating hadoop yarn with mesos infra
I have created a hdfs cluster . I have to configure yarn so as to allow yarn application master to be able to create containers for job processing on the mesos cluster on demand .
how can i integrate ...
Score of 1
1 answer
89 views
Once tasks are finished does Mesos Agent kill the Mesos Executor that was running the tasks or does the Mesos Executor persist to receive new tasks?
I'm trying to better understand when Mesos Executors are killed by Mesos Agents once tasks that are running in the Mesos Executors finish. Does the Mesos Agent automatically kill Mesos Executors if ...
Score of 2
1 answer
397 views
Where can I find binary packages for Apache Mesos?
I have been trying to install mesos on my VM. To be specific on Ubuntu Focal Fossa. However, I googled this and didn't saw any repository/binary packages for mesos. Can someone help me with this?
I ...
Score of 0
1 answer
29 views
Standalone mesos master behind load balancer EC2
I have a mesos master behind a load balancer and a mesos agent that tries to connect to the mesos master via the load balancer
Everything is good when the agent directly connects to the master by ...
Score of 0
1 answer
205 views
I wonder why many resource managers (Yarn, Mesos, Kubernetes etc.) do not support setting the disk I/O resource usage of containers
In most resource managers, we can set the container's CPU usage and memory usage.
But I'm curious about the technical reasons for not supporting disk I/O resource allocation for containers.
Score of 2
1 answer
292 views
Is Celery a "real" scheduler like PBS, MESOS or YARN?
I have an existing application that is using Celery.
Clients submit tasks to Celery, and Celery's workers unstack those tasks and run it, accross different physical hosts.
Each Celery worker run a ...