Skip to content

Comments

feat: taskmanager kubernetes watch job status and support hadoop#3157

Merged
tobegit3hub merged 7 commits into4paradigm:mainfrom
tobegit3hub:feat/taskmanager_kubernetes_watch_job_status
Apr 3, 2023
Merged

feat: taskmanager kubernetes watch job status and support hadoop#3157
tobegit3hub merged 7 commits into4paradigm:mainfrom
tobegit3hub:feat/taskmanager_kubernetes_watch_job_status

Conversation

@tobegit3hub
Copy link
Collaborator

@tobegit3hub tobegit3hub commented Mar 22, 2023

  • Watch k8s job status and update internal table, support blocking mode
  • Support hadoop config in kubernetes mode

Usage:

Create k8s hadoop configmap.

kubectl create configmap hadoop-config --from-file=/Users/tobe/software/2023_hadoop/hadoop-3.3.4/etc/hadoop_simple/

You can update the configmap by add config in taskmanager.properties.

k8s.hadoop.configmap=hadoop-config

@tobegit3hub tobegit3hub self-assigned this Mar 22, 2023
@github-actions github-actions bot added the task-manager openmldb taskmanager label Mar 22, 2023
@codecov
Copy link

codecov bot commented Mar 22, 2023

Codecov Report

Patch coverage has no change and project coverage change: -0.04 ⚠️

Comparison is base (363096d) 75.69% compared to head (81574ba) 75.65%.

Additional details and impacted files
@@             Coverage Diff              @@
##               main    #3157      +/-   ##
============================================
- Coverage     75.69%   75.65%   -0.04%     
  Complexity      393      393              
============================================
  Files           675      677       +2     
  Lines        125023   125329     +306     
  Branches       1139     1177      +38     
============================================
+ Hits          94631    94819     +188     
- Misses        30156    30274     +118     
  Partials        236      236              
Impacted Files Coverage Δ
...openmldb/taskmanager/config/TaskManagerConfig.java 0.00% <0.00%> (ø)
...nmldb/taskmanager/server/impl/TaskManagerImpl.java 0.00% <0.00%> (ø)
...adigm/openmldb/taskmanager/k8s/K8sJobManager.scala 0.00% <0.00%> (ø)

... and 33 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@dl239
Copy link
Collaborator

dl239 commented Mar 31, 2023

please add relevant docs

@tobegit3hub tobegit3hub merged commit 4f1294c into 4paradigm:main Apr 3, 2023
@lqy222 lqy222 mentioned this pull request May 8, 2023
@lumianph lumianph added the alpha this feature is not fully tested or functional label May 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

alpha this feature is not fully tested or functional task-manager openmldb taskmanager

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants