taskflow

breadth_first_iterate function execute takes too much time

Asked by imliuda

Hi, i am using taskflow to build a cloud based deployment system. this system is also based on openstack sahara. I write a basic flow to deploy a spark cluster on a cloud platform, this flow includes server allocating, system setup, etc. attachment is a detailed flow generated by taskflow's export_to_dot().

The problem is that, when tasks in the flow becomes more, like in the attachment, this flow schdule is very slow, and have a 100% cpu usage. I found the taskflow is running in breadth_first_iterate() (taskflow/engines/action_engine/traversal.py) function. I try to print(node) in that function. there are very very much atom with same name. Is that a bug? or how can i optimise it.

-----------------------------------
Release: on 2018-06-13 10:57:58
SHA: b46cf94a25d45dd16362ffe7179c7f426c12e097
Source: https://opendev.org/openstack/taskflow/src/doc/source/index.rst
URL: https://docs.openstack.org/taskflow/latest/

Question information

Language:
English Edit question
Status:
Expired
For:
taskflow Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:

This question was originally filed as bug #1872666.

Revision history for this message
imliuda (imiuda) said : 		#1
Revision history for this message
Launchpad Janitor (janitor) said : 		#2

This question was expired because it remained in the 'Open' state without activity for the last 15 days.

Revision history for this message
imliuda (imiuda) said : 		#3

any body can help?

Revision history for this message
Launchpad Janitor (janitor) said : 		#4

This question was expired because it remained in the 'Open' state without activity for the last 15 days.