How to add LinkedIn's Burrow to a Docker Compose?
It appears LinkedIn doesn't have an official Burrow docker image on Docker Hub, but there are others who have forked it.
However, I can't find any examples of how to add any of them to a docker compose file that spins up ZK and Kafka something like this.
What am I missing?
docker apache-kafka docker-compose devops
edited Dec 28 '18 at 18:51
cricket_007
80k1142110
asked Dec 28 '18 at 14:22
Marcel LamotheMarcel Lamothe
5,10272639
|
show 2 more comments
It appears LinkedIn doesn't have an official Burrow docker image on Docker Hub, but there are others who have forked it.
However, I can't find any examples of how to add any of them to a docker compose file that spins up ZK and Kafka something like this.
What am I missing?
docker apache-kafka docker-compose devops
edited Dec 28 '18 at 18:51
cricket_007
80k1142110
asked Dec 28 '18 at 14:22
Marcel LamotheMarcel Lamothe
5,10272639
Could you show what you have tried so far? AFAIK, Burrow only needs to know where the bootstrap servers exist, and if that is available to be configured by a file or an Environment variable, then what issues are you having creating a compose file for this?
– cricket_007
Dec 28 '18 at 18:50
I don't even know where to begin. "Burrow only needs to know where the bootstrap servers exist" - is that an environment variable? If so, what is is called? I guess the whole question could be summed up as: Is there any documentation, anywhere?
– Marcel Lamothe
Dec 28 '18 at 19:20
Burrow's documentation is on Github... And last time I checked, it used a config file located at/etc/burrow, and mentioned on Github, it says use a Docker volume mount - github.com/linkedin/Burrow#using-docker .. So, again, I ask, what issues are you running into so far?
– cricket_007
Dec 28 '18 at 19:22
An alternative to try is Remora, which does have a Docker compose example for you github.com/zalando-incubator/remora/blob/master/basic-example/…
– cricket_007
Dec 28 '18 at 19:28
1
Umm. Maybe you missed this? github.com/linkedin/Burrow/blob/master/docker-compose.yml
– cricket_007
Dec 28 '18 at 19:39
|
show 2 more comments
It appears LinkedIn doesn't have an official Burrow docker image on Docker Hub, but there are others who have forked it.
However, I can't find any examples of how to add any of them to a docker compose file that spins up ZK and Kafka something like this.
What am I missing?
docker apache-kafka docker-compose devops
edited Dec 28 '18 at 18:51
cricket_007
80k1142110
asked Dec 28 '18 at 14:22
Marcel LamotheMarcel Lamothe
5,10272639
It appears LinkedIn doesn't have an official Burrow docker image on Docker Hub, but there are others who have forked it.
However, I can't find any examples of how to add any of them to a docker compose file that spins up ZK and Kafka something like this.
What am I missing?
docker apache-kafka docker-compose devops
docker apache-kafka docker-compose devops
edited Dec 28 '18 at 18:51
cricket_007
80k1142110
asked Dec 28 '18 at 14:22
Marcel LamotheMarcel Lamothe
5,10272639
edited Dec 28 '18 at 18:51
cricket_007
80k1142110
asked Dec 28 '18 at 14:22
Marcel LamotheMarcel Lamothe
5,10272639
edited Dec 28 '18 at 18:51
cricket_007
80k1142110
edited Dec 28 '18 at 18:51
cricket_007
80k1142110
edited Dec 28 '18 at 18:51
cricket_007
80k1142110
80k1142110
asked Dec 28 '18 at 14:22
Marcel LamotheMarcel Lamothe
5,10272639
asked Dec 28 '18 at 14:22
Marcel LamotheMarcel Lamothe
5,10272639
asked Dec 28 '18 at 14:22
Marcel LamotheMarcel Lamothe
5,10272639
5,10272639
Could you show what you have tried so far? AFAIK, Burrow only needs to know where the bootstrap servers exist, and if that is available to be configured by a file or an Environment variable, then what issues are you having creating a compose file for this?
– cricket_007
Dec 28 '18 at 18:50
I don't even know where to begin. "Burrow only needs to know where the bootstrap servers exist" - is that an environment variable? If so, what is is called? I guess the whole question could be summed up as: Is there any documentation, anywhere?
– Marcel Lamothe
Dec 28 '18 at 19:20
Burrow's documentation is on Github... And last time I checked, it used a config file located at/etc/burrow, and mentioned on Github, it says use a Docker volume mount - github.com/linkedin/Burrow#using-docker .. So, again, I ask, what issues are you running into so far?
– cricket_007
Dec 28 '18 at 19:22
An alternative to try is Remora, which does have a Docker compose example for you github.com/zalando-incubator/remora/blob/master/basic-example/…
– cricket_007
Dec 28 '18 at 19:28
1
Umm. Maybe you missed this? github.com/linkedin/Burrow/blob/master/docker-compose.yml
– cricket_007
Dec 28 '18 at 19:39
|
show 2 more comments
Could you show what you have tried so far? AFAIK, Burrow only needs to know where the bootstrap servers exist, and if that is available to be configured by a file or an Environment variable, then what issues are you having creating a compose file for this?
– cricket_007
Dec 28 '18 at 18:50
I don't even know where to begin. "Burrow only needs to know where the bootstrap servers exist" - is that an environment variable? If so, what is is called? I guess the whole question could be summed up as: Is there any documentation, anywhere?
– Marcel Lamothe
Dec 28 '18 at 19:20
Burrow's documentation is on Github... And last time I checked, it used a config file located at/etc/burrow, and mentioned on Github, it says use a Docker volume mount - github.com/linkedin/Burrow#using-docker .. So, again, I ask, what issues are you running into so far?
– cricket_007
Dec 28 '18 at 19:22
An alternative to try is Remora, which does have a Docker compose example for you github.com/zalando-incubator/remora/blob/master/basic-example/…
– cricket_007
Dec 28 '18 at 19:28
1
Umm. Maybe you missed this? github.com/linkedin/Burrow/blob/master/docker-compose.yml
– cricket_007
Dec 28 '18 at 19:39
Could you show what you have tried so far? AFAIK, Burrow only needs to know where the bootstrap servers exist, and if that is available to be configured by a file or an Environment variable, then what issues are you having creating a compose file for this?
– cricket_007
Dec 28 '18 at 18:50
Could you show what you have tried so far? AFAIK, Burrow only needs to know where the bootstrap servers exist, and if that is available to be configured by a file or an Environment variable, then what issues are you having creating a compose file for this?
– cricket_007
Dec 28 '18 at 18:50
I don't even know where to begin. "Burrow only needs to know where the bootstrap servers exist" - is that an environment variable? If so, what is is called? I guess the whole question could be summed up as: Is there any documentation, anywhere?
– Marcel Lamothe
Dec 28 '18 at 19:20
I don't even know where to begin. "Burrow only needs to know where the bootstrap servers exist" - is that an environment variable? If so, what is is called? I guess the whole question could be summed up as: Is there any documentation, anywhere?
– Marcel Lamothe
Dec 28 '18 at 19:20
Burrow's documentation is on Github... And last time I checked, it used a config file located at
/etc/burrow, and mentioned on Github, it says use a Docker volume mount - github.com/linkedin/Burrow#using-docker .. So, again, I ask, what issues are you running into so far?– cricket_007
Dec 28 '18 at 19:22
Burrow's documentation is on Github... And last time I checked, it used a config file located at
/etc/burrow, and mentioned on Github, it says use a Docker volume mount - github.com/linkedin/Burrow#using-docker .. So, again, I ask, what issues are you running into so far?– cricket_007
Dec 28 '18 at 19:22
An alternative to try is Remora, which does have a Docker compose example for you github.com/zalando-incubator/remora/blob/master/basic-example/…
– cricket_007
Dec 28 '18 at 19:28
An alternative to try is Remora, which does have a Docker compose example for you github.com/zalando-incubator/remora/blob/master/basic-example/…
– cricket_007
Dec 28 '18 at 19:28
1
1
Umm. Maybe you missed this? github.com/linkedin/Burrow/blob/master/docker-compose.yml
– cricket_007
Dec 28 '18 at 19:39
Umm. Maybe you missed this? github.com/linkedin/Burrow/blob/master/docker-compose.yml
– cricket_007
Dec 28 '18 at 19:39
|
show 2 more comments
1 Answer
1
active
oldest
votes
It appears LinkedIn doesn't have an official Burrow docker image on Docker Hub
No, and while @toddpalino is one of the maintainers of Burrow, and has it on his Docker Hub account he states that providing a Docker image is not a core tenant of the project
In any case, there is a Docker Compose file in the Github repo, so you're welcome to clone the project and build an image yourself. I have opened a PR to make the README more clear that it does exists.
Regarding the configuration, the TOML file is linked into /etc/burrow of the container, and you would need to edit that file locally, and use a Compose volume mount to connect to an externally available Kafka broker or container.
answered Dec 28 '18 at 20:03
cricket_007cricket_007
80k1142110
All very much appreciated, thank you!
– Marcel Lamothe
Dec 28 '18 at 20:04
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53959986%2fhow-to-add-linkedins-burrow-to-a-docker-compose%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
It appears LinkedIn doesn't have an official Burrow docker image on Docker Hub
No, and while @toddpalino is one of the maintainers of Burrow, and has it on his Docker Hub account he states that providing a Docker image is not a core tenant of the project
In any case, there is a Docker Compose file in the Github repo, so you're welcome to clone the project and build an image yourself. I have opened a PR to make the README more clear that it does exists.
Regarding the configuration, the TOML file is linked into /etc/burrow of the container, and you would need to edit that file locally, and use a Compose volume mount to connect to an externally available Kafka broker or container.
answered Dec 28 '18 at 20:03
cricket_007cricket_007
80k1142110
All very much appreciated, thank you!
– Marcel Lamothe
Dec 28 '18 at 20:04
add a comment |
It appears LinkedIn doesn't have an official Burrow docker image on Docker Hub
No, and while @toddpalino is one of the maintainers of Burrow, and has it on his Docker Hub account he states that providing a Docker image is not a core tenant of the project
In any case, there is a Docker Compose file in the Github repo, so you're welcome to clone the project and build an image yourself. I have opened a PR to make the README more clear that it does exists.
Regarding the configuration, the TOML file is linked into /etc/burrow of the container, and you would need to edit that file locally, and use a Compose volume mount to connect to an externally available Kafka broker or container.
answered Dec 28 '18 at 20:03
cricket_007cricket_007
80k1142110
All very much appreciated, thank you!
– Marcel Lamothe
Dec 28 '18 at 20:04
add a comment |
It appears LinkedIn doesn't have an official Burrow docker image on Docker Hub
No, and while @toddpalino is one of the maintainers of Burrow, and has it on his Docker Hub account he states that providing a Docker image is not a core tenant of the project
In any case, there is a Docker Compose file in the Github repo, so you're welcome to clone the project and build an image yourself. I have opened a PR to make the README more clear that it does exists.
Regarding the configuration, the TOML file is linked into /etc/burrow of the container, and you would need to edit that file locally, and use a Compose volume mount to connect to an externally available Kafka broker or container.
answered Dec 28 '18 at 20:03
cricket_007cricket_007
80k1142110
It appears LinkedIn doesn't have an official Burrow docker image on Docker Hub
No, and while @toddpalino is one of the maintainers of Burrow, and has it on his Docker Hub account he states that providing a Docker image is not a core tenant of the project
In any case, there is a Docker Compose file in the Github repo, so you're welcome to clone the project and build an image yourself. I have opened a PR to make the README more clear that it does exists.
Regarding the configuration, the TOML file is linked into /etc/burrow of the container, and you would need to edit that file locally, and use a Compose volume mount to connect to an externally available Kafka broker or container.
answered Dec 28 '18 at 20:03
cricket_007cricket_007
80k1142110
answered Dec 28 '18 at 20:03
cricket_007cricket_007
80k1142110
answered Dec 28 '18 at 20:03
cricket_007cricket_007
80k1142110
answered Dec 28 '18 at 20:03
cricket_007cricket_007
80k1142110
80k1142110
All very much appreciated, thank you!
– Marcel Lamothe
Dec 28 '18 at 20:04
add a comment |
All very much appreciated, thank you!
– Marcel Lamothe
Dec 28 '18 at 20:04
All very much appreciated, thank you!
– Marcel Lamothe
Dec 28 '18 at 20:04
All very much appreciated, thank you!
– Marcel Lamothe
Dec 28 '18 at 20:04
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53959986%2fhow-to-add-linkedins-burrow-to-a-docker-compose%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Could you show what you have tried so far? AFAIK, Burrow only needs to know where the bootstrap servers exist, and if that is available to be configured by a file or an Environment variable, then what issues are you having creating a compose file for this?
– cricket_007
Dec 28 '18 at 18:50
I don't even know where to begin. "Burrow only needs to know where the bootstrap servers exist" - is that an environment variable? If so, what is is called? I guess the whole question could be summed up as: Is there any documentation, anywhere?
– Marcel Lamothe
Dec 28 '18 at 19:20
Burrow's documentation is on Github... And last time I checked, it used a config file located at
/etc/burrow, and mentioned on Github, it says use a Docker volume mount - github.com/linkedin/Burrow#using-docker .. So, again, I ask, what issues are you running into so far?– cricket_007
Dec 28 '18 at 19:22
An alternative to try is Remora, which does have a Docker compose example for you github.com/zalando-incubator/remora/blob/master/basic-example/…
– cricket_007
Dec 28 '18 at 19:28
1
Umm. Maybe you missed this? github.com/linkedin/Burrow/blob/master/docker-compose.yml
– cricket_007
Dec 28 '18 at 19:39