Skip to content

Conversation

@Yancey0623
Copy link
Collaborator

@Yancey0623 Yancey0623 commented Nov 27, 2019

part work of #1066
TODO: add e2e test for couler mode

@Yancey0623 Yancey0623 changed the title []implement couler codegen [wip]implement couler codegen Nov 27, 2019
@Yancey0623 Yancey0623 changed the title [wip]implement couler codegen implement couler codegen Nov 27, 2019
}

// 3. submit Argo YAML and fetch the workflow ID.
cmd = exec.Command("kubectl", "create", "-f", argoYaml.Name())
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can use k8s API here?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, will import k8s package when implement Fetch gRPC interface, and I will rewrite here to use k8s API.

typhoonzero
typhoonzero previously approved these changes Nov 28, 2019
r := &coulerFiller{}
for _, sqlIR := range programIR {
ss := &sqlStatment{}
switch sqlIR.(type) {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we need to update this implement to #1272.

# TODO(yancey1989):
# using "repl -parse" to output IR and
# feed to "sqlflow_submitter.{submitter}.train" to submite the job
couler.run_container(command='''repl -e "{{ $ss.OriginalSQL }}"''', image="{{ $ss.DockerImage }}")
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe add env as the session at here.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You're right, will add it in the next PR.

@Yancey0623 Yancey0623 merged commit 2a7b566 into sql-machine-learning:develop Nov 28, 2019
@Yancey0623 Yancey0623 deleted the couler_codegen branch November 28, 2019 10:45
@Yancey0623 Yancey0623 mentioned this pull request Dec 10, 2019
21 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants