Skip to content

SAMZA-2296: Metadata streams not created in Standalone - #1132

Merged
shanthoosh merged 2 commits into
apache:masterfrom
dnishimura:samza-2296-standalone-metadata-streams-creation-bug
Aug 9, 2019
Merged

shanthoosh merged 2 commits into
apache:masterfrom
dnishimura:samza-2296-standalone-metadata-streams-creation-bug

Conversation

@dnishimura

Copy link
Copy Markdown
Contributor

Root cause
In standalone, the configs are being read from the JobModel, but in the standalone scenario, the config in the JobModel is not populated. The checkpoint and changelog system configurations were attempted to be read from the job model rather than the internally constructed configs.

Fix
Use the constructed config rather than the configs from JobModel

@dnishimura

dnishimura commented Aug 8, 2019 •

Copy link
Copy Markdown
Contributor Author

Please review, but hold off merges until I do some testing.

@dnishimura

Copy link
Copy Markdown
Contributor Author

Tested the fix on a backport to Samza 1.2 with a test standalone and test yarn job. I tested on both existing instances of the jobs and new instances of the jobs to trigger the creation of the new metadata streams. All verified to work. Please review.

@Sanil15 Sanil15 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the patch

@shanthoosh shanthoosh left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the changes.

Fix it, then ship it.

@shanthoosh
shanthoosh merged commit 4b012d9 into apache:master Aug 9, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants