*** Bhujay has joined #openstack-sahara | 02:28 | |
*** links has joined #openstack-sahara | 04:02 | |
*** Bhujay has quit IRC | 06:28 | |
*** Bhujay has joined #openstack-sahara | 06:29 | |
*** Bhujay has quit IRC | 06:52 | |
*** Bhujay has joined #openstack-sahara | 06:56 | |
*** tesseract has joined #openstack-sahara | 07:12 | |
*** masber has joined #openstack-sahara | 07:17 | |
*** Bhujay has quit IRC | 07:29 | |
*** Bhujay has joined #openstack-sahara | 07:29 | |
*** Bhujay has quit IRC | 07:47 | |
*** Bhujay has joined #openstack-sahara | 07:48 | |
*** tosky has joined #openstack-sahara | 08:06 | |
*** rcernin has quit IRC | 08:46 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_sahara master: [DNM] Test nova is behaving correctly https://review.openstack.org/582478 | 09:22 |
---|---|---|
*** Bhujay has quit IRC | 09:50 | |
*** Bhujay has joined #openstack-sahara | 09:51 | |
openstackgerrit | Luigi Toscano proposed openstack/python-saharaclient master: Revert "Fix the cover tox target (switch to stestr)" https://review.openstack.org/582510 | 11:36 |
openstackgerrit | Luigi Toscano proposed openstack/python-saharaclient master: Fix the cover tox target (switch to stestr) https://review.openstack.org/582511 | 11:41 |
openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara master: Adding Ambari 2.6 to image pack https://review.openstack.org/579024 | 11:44 |
openstackgerrit | Jeremy Freudberg proposed openstack/python-saharaclient master: Correct a missed job_execution->job https://review.openstack.org/582519 | 12:19 |
tellesnobrega | tosky, passed that stage on spark, now it is stuck checking if datanode is running | 12:31 |
tosky | and is it really running? | 12:32 |
tellesnobrega | yes | 12:34 |
tellesnobrega | the command returns connection refused | 12:34 |
tellesnobrega | http://paste.openstack.org/show/725820/ | 12:35 |
tosky | a hostname issue maybe? | 12:36 |
tellesnobrega | probably not | 12:37 |
tellesnobrega | /etc/hosts is configured correctly | 12:38 |
tosky | so you can see both spark-spark-slave-0 and spark-spark-master-0, with and without the .novalocal suffix? | 12:42 |
tosky | is the 8020 port on master open for all sources? | 12:43 |
tosky | is the 8020 port open on netfilter/iptables? | 12:43 |
*** hoonetorg has quit IRC | 12:43 | |
tellesnobrega | for the first question | 12:44 |
tellesnobrega | yes, and I can ssh to it | 12:44 |
tosky | more telnet or nc | 12:44 |
tosky | oh, that's the first question, not about the port | 12:44 |
tellesnobrega | 8020 is open on security groups | 12:45 |
tellesnobrega | IngressIPv4TCP80200.0.0.0/0 | 12:45 |
tellesnobrega | IngressIPv6TCP8020::/0 | 12:46 |
tosky | and locally on the master host? | 12:50 |
tosky | fro mnetstat (or ss) | 12:50 |
tosky | ss -ntp | 12:51 |
tellesnobrega | http://paste.openstack.org/show/725823/ | 12:51 |
tellesnobrega | ss -ntp ^ | 12:51 |
tellesnobrega | iptables -L | 12:52 |
tellesnobrega | http://paste.openstack.org/show/725824/ | 12:52 |
tosky | I'm still learning ss (now that netstat is deprecated), so I think that the correct form to show listening ports should be | 12:54 |
tosky | ss -lutp | 12:55 |
tosky | or something like that | 12:55 |
*** Bhujay has quit IRC | 12:55 | |
*** Bhujay has joined #openstack-sahara | 12:55 | |
tellesnobrega | http://paste.openstack.org/show/725825/ | 12:56 |
tellesnobrega | don't think it is open | 12:56 |
tosky | uhm | 12:57 |
tosky | or I still don't know ss properly | 12:57 |
tellesnobrega | ss -l | 12:58 |
tellesnobrega | http://paste.openstack.org/show/725826/ | 12:59 |
*** links has quit IRC | 12:59 | |
*** Bhujay has quit IRC | 13:00 | |
*** Bhujay has joined #openstack-sahara | 13:00 | |
tosky | tellesnobrega: so I guess that if you run that same command hdfs dfsadmin etc on master directly, it would fail too? | 13:00 |
tellesnobrega | it does | 13:01 |
*** hoonetorg has joined #openstack-sahara | 13:01 | |
tellesnobrega | any ideas? | 13:03 |
tosky | uh, check if the service did not start | 13:03 |
tosky | recheck the logs when it was supposed to start | 13:04 |
tellesnobrega | tosky, looks like you were right | 13:06 |
tellesnobrega | SHUTDOWN_MSG: Shutting down NameNode at java.net.UnknownHostException: spark-spark-master-0: spark-spark-master-0: Name or service not known | 13:06 |
openstackgerrit | Luigi Toscano proposed openstack/openstack-ansible-os_sahara master: Add few more services to the inventory (nova, memcached) https://review.openstack.org/582538 | 13:19 |
openstackgerrit | Luigi Toscano proposed openstack/sahara master: api-ref: move to a v1.1 sub-folder https://review.openstack.org/582540 | 13:20 |
tellesnobrega | tosky, it is related to name.novalocal stuff | 13:57 |
tellesnobrega | but even weirder is, if I stop the service and start it again, it works | 14:02 |
tellesnobrega | no need for other changes | 14:02 |
tosky | tellesnobrega: uhm | 14:07 |
tosky | so maybe something is configured later? | 14:07 |
tosky | not yet configured when the services is started first? | 14:08 |
tosky | oh, the review which removes the legacy jobs for sahara-extra was merged | 14:08 |
tosky | so we need this, or we won't be able to publish new changes in sahara-extra: https://review.openstack.org/#/c/532691/ | 14:09 |
tosky | it should work, but we will see only when it merges | 14:09 |
tosky | as post job, it can't be tested before merging | 14:09 |
tellesnobrega | merging now | 14:10 |
tosky | thanks | 14:10 |
tosky | we have just one legacy job remaining, the integration test forsahara-dashboard; I have a WIP for that | 14:10 |
tellesnobrega | nice | 14:11 |
tellesnobrega | tried spark 1.6.0, config /etc/hosts looks the same | 14:13 |
openstackgerrit | Merged openstack/python-saharaclient master: Revert "Fix the cover tox target (switch to stestr)" https://review.openstack.org/582510 | 14:14 |
tellesnobrega | so, when spark 1.6.0 starts the logs are named hadoop-hdfs-datanode-spark160-spark-slave160-0.novalocal.log | 14:18 |
tellesnobrega | while the 2.2 is named hadoop-hdfs-datanode-spark22-spark-slave22-0.log | 14:18 |
tosky | and the content of /etc/hosts? Is it the same for both? | 14:19 |
tellesnobrega | when I stop and start again, 2.2 is named the same and it works | 14:19 |
tellesnobrega | yes | 14:19 |
tellesnobrega | for some reason the first run on 2.2 is getting the wrong naming | 14:19 |
openstackgerrit | Jeremy Freudberg proposed openstack/sahara-dashboard master: APIv2 in dashboard https://review.openstack.org/581878 | 14:20 |
tellesnobrega | tosky, maybe, just maybe, I need to stop the services after install | 14:24 |
tellesnobrega | that might the problem | 14:24 |
tosky | and why isn't it the case with 1.6? | 14:25 |
tellesnobrega | different image gen process | 14:25 |
tellesnobrega | I might have missed something | 14:25 |
tosky | so maybe there is something else different | 14:25 |
tosky | yep | 14:25 |
tosky | maybe the service is disabled when installed with sie | 14:25 |
tellesnobrega | that is what I'm thinking as well | 14:25 |
tellesnobrega | I will try to run a stop_services script | 14:26 |
tellesnobrega | there is turn-off services | 14:26 |
tellesnobrega | I missed it | 14:26 |
*** jeremyfreudberg has joined #openstack-sahara | 14:29 | |
jeremyfreudberg | tellesnobrega, i ran out of time for decomission specific node | 14:29 |
tellesnobrega | jeremyfreudberg, dashboard part? | 14:29 |
jeremyfreudberg | yes, dashboard | 14:29 |
tellesnobrega | no worries, I will give it a try | 14:30 |
jeremyfreudberg | thanks | 14:30 |
tellesnobrega | dashboard is not my strong suit | 14:30 |
tellesnobrega | but I will try | 14:30 |
jeremyfreudberg | yeah, it can get rough quickly | 14:30 |
jeremyfreudberg | anyway -- my work is just about done. review it, merge it, i'll be around to respond to feedback but probably can't push any new patchsets | 14:32 |
tellesnobrega | sounds good | 14:32 |
tellesnobrega | if any urgent stuff come up I can write a follow up patch | 14:32 |
jeremyfreudberg | remember to do a saharaclient release when enough (all?) of the good stuff is merged, and bump the sahara-dashboard requirements | 14:32 |
jeremyfreudberg | yep | 14:33 |
jeremyfreudberg | i will still be keeping an eye on things | 14:33 |
tellesnobrega | thanks | 14:33 |
jeremyfreudberg | and have plenty of reminders and explanatinos for the confusing stuff | 14:33 |
tellesnobrega | sounds good | 14:34 |
jeremyfreudberg | email or review comments if you need anything | 14:37 |
jeremyfreudberg | bye | 14:37 |
*** jeremyfreudberg has quit IRC | 14:37 | |
openstackgerrit | Merged openstack/sahara master: Adding Storm 1.2.0 and 1.2.1 https://review.openstack.org/577815 | 14:39 |
openstackgerrit | Luigi Toscano proposed openstack/openstack-ansible-os_sahara master: Add few more services to the inventory (nova, memcached) https://review.openstack.org/582538 | 14:42 |
tosky | uh, thanks Jeremy | 14:42 |
openstackgerrit | Merged openstack/sahara-extra master: Add native Zuul v3 build and publishing jobs https://review.openstack.org/532691 | 14:44 |
*** tesseract has quit IRC | 15:21 | |
*** Bhujay has quit IRC | 15:40 | |
openstackgerrit | Luigi Toscano proposed openstack/openstack-ansible-os_sahara master: Add few more services to the inventory (nova, memcached) https://review.openstack.org/582538 | 16:08 |
openstackgerrit | Jeremy Freudberg proposed openstack/python-saharaclient master: Clean S3 data source create/update https://review.openstack.org/582643 | 17:08 |
*** Bhujay has joined #openstack-sahara | 17:54 | |
*** Bhujay has quit IRC | 17:59 | |
openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/python-saharaclient master: Adding boot from volume https://review.openstack.org/572536 | 19:34 |
openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/python-saharaclient master: Adding boot from volume to osc https://review.openstack.org/582319 | 19:40 |
openstackgerrit | Luigi Toscano proposed openstack/sahara-extra master: Fix the post-publishing job: correct src directory https://review.openstack.org/582676 | 19:53 |
tosky | blindly hoping that it would work ^^ | 19:54 |
openstackgerrit | Merged openstack/python-saharaclient master: Correct a missed job_execution->job https://review.openstack.org/582519 | 20:41 |
-openstackstatus- NOTICE: logs.openstack.org is offline, causing POST_FAILURE results from Zuul. Cause and resolution timeframe currently unknown. | 21:51 | |
*** ChanServ changes topic to "logs.openstack.org is offline, causing POST_FAILURE results from Zuul. Cause and resolution timeframe currently unknown." | 21:51 | |
*** ChanServ changes topic to "OpenStack Sahara // IRC Meetings - http://eavesdrop.openstack.org/#OpenStack_Data_Processing_(Sahara)_Team_Meeting" | 23:36 | |
-openstackstatus- NOTICE: logs.openstack.org is back on-line. Changes with "POST_FAILURE" job results should be rechecked. | 23:36 | |
*** tosky has quit IRC | 23:41 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!