Saturday, 2019-04-27

*** lseki has quit IRC00:05
*** rcernin has joined #openstack-infra00:12
*** Weifan has quit IRC00:13
*** yamamoto has joined #openstack-infra00:28
*** mattw4 has quit IRC00:29
*** bhavikdbavishi has quit IRC00:44
*** bhavikdbavishi has joined #openstack-infra00:45
*** jamesmcarthur has joined #openstack-infra00:53
*** yamamoto has quit IRC01:04
*** yamamoto has joined #openstack-infra01:04
*** michael-beaver has quit IRC01:05
openstackgerritMerged zuul/zuul master: Fix test race in test_job_pause_post_fail  https://review.opendev.org/65601901:08
*** slaweq has joined #openstack-infra01:11
*** slaweq has quit IRC01:15
*** Goneri has quit IRC01:17
*** michael-beaver has joined #openstack-infra01:23
*** markvoelker has joined #openstack-infra01:27
*** jamesmcarthur has quit IRC01:50
*** yamamoto has quit IRC01:52
*** apetrich has quit IRC01:57
*** jamesmcarthur has joined #openstack-infra02:15
*** yamamoto has joined #openstack-infra02:16
*** imacdonn has quit IRC02:25
*** yamamoto has quit IRC02:29
*** Lucas_Gray has quit IRC02:35
*** jamesmcarthur has quit IRC02:41
*** hwoarang has quit IRC02:56
*** hwoarang has joined #openstack-infra02:57
openstackgerritMerged zuul/zuul master: Fix race in test_job_pause_retry  https://review.opendev.org/65600403:00
*** slaweq has joined #openstack-infra03:11
*** jamesmcarthur has joined #openstack-infra03:12
*** rtjure has quit IRC03:14
*** slaweq has quit IRC03:16
*** rtjure has joined #openstack-infra03:23
*** jamesmcarthur has quit IRC03:27
*** rcernin has quit IRC03:27
*** jamesmcarthur has joined #openstack-infra03:32
*** anteaya has quit IRC03:33
*** michael-beaver has quit IRC03:35
*** yamamoto has joined #openstack-infra03:41
*** rh-jelabarre has quit IRC03:41
*** lseki has joined #openstack-infra03:44
*** jamesmcarthur has quit IRC03:46
*** jamesmcarthur has joined #openstack-infra03:46
*** yamamoto has quit IRC03:48
*** jamesmcarthur has quit IRC04:15
*** jamesmcarthur has joined #openstack-infra04:29
*** hwoarang has quit IRC04:32
*** jamesmcarthur has quit IRC04:33
*** hwoarang has joined #openstack-infra04:34
*** whoami-rajat has joined #openstack-infra04:36
*** weshay1 has joined #openstack-infra04:45
*** rnoriega has quit IRC04:46
*** otherwiseguy_ has joined #openstack-infra04:47
*** pabelanger has quit IRC04:47
*** otherwiseguy has quit IRC04:47
*** mhu has quit IRC04:47
*** weshay has quit IRC04:48
*** mhu has joined #openstack-infra04:57
*** weshay16 has joined #openstack-infra04:57
*** otherwiseguy has joined #openstack-infra04:57
*** otherwiseguy_ has quit IRC04:59
*** weshay1 has quit IRC05:01
*** weshay161 has joined #openstack-infra05:01
*** otherwiseguy_ has joined #openstack-infra05:02
*** mhu has quit IRC05:04
*** otherwiseguy has quit IRC05:04
*** weshay16 has quit IRC05:04
*** slaweq has joined #openstack-infra05:11
*** yamamoto has joined #openstack-infra05:11
*** slaweq has quit IRC05:15
*** mhu has joined #openstack-infra05:19
*** weshay1616 has joined #openstack-infra05:19
*** otherwiseguy has joined #openstack-infra05:20
*** otherwiseguy_ has quit IRC05:21
*** lpetrut has joined #openstack-infra05:21
*** weshay161 has quit IRC05:22
*** weshay16167 has joined #openstack-infra05:25
*** otherwiseguy_ has joined #openstack-infra05:26
*** otherwiseguy has quit IRC05:27
*** mhu has quit IRC05:28
*** weshay1616 has quit IRC05:28
*** mhu has joined #openstack-infra05:28
*** weshay161678 has joined #openstack-infra05:28
*** gmann has quit IRC05:30
*** otherwiseguy_ has quit IRC05:30
*** otherwiseguy has joined #openstack-infra05:31
*** hwoarang has quit IRC05:31
*** weshay16167 has quit IRC05:32
*** hwoarang has joined #openstack-infra05:33
*** ykarel|away has joined #openstack-infra05:35
*** e0ne has joined #openstack-infra05:56
*** pcaruana has joined #openstack-infra05:58
*** lseki has quit IRC06:08
*** pcaruana has quit IRC06:10
*** e0ne has quit IRC06:11
*** yamamoto has quit IRC06:14
*** lpetrut has quit IRC06:15
*** bhavikdbavishi has quit IRC06:29
*** bhavikdbavishi has joined #openstack-infra06:30
*** lpetrut has joined #openstack-infra06:34
*** slaweq has joined #openstack-infra06:43
*** bhavikdbavishi has quit IRC06:44
openstackgerritMerged zuul/zuul master: Fix tox.ini cover target install command  https://review.opendev.org/65272706:44
*** slaweq has quit IRC06:48
*** altlogbot_2 has quit IRC06:49
*** altlogbot_0 has joined #openstack-infra06:50
*** yamamoto has joined #openstack-infra06:57
*** yamamoto has quit IRC07:02
openstackgerritMerged zuul/zuul master: Include zookeeper.hosts in ZFS example zuul.conf  https://review.opendev.org/65448307:08
*** yamamoto has joined #openstack-infra07:13
openstackgerritMerged zuul/zuul master: Fix requirements loop warning  https://review.opendev.org/65578107:25
*** yamamoto has quit IRC07:26
*** slaweq has joined #openstack-infra07:27
*** yamamoto has joined #openstack-infra07:28
openstackgerritAndreas Jaeger proposed openstack/openstack-zuul-jobs master: Stop queens translation  https://review.opendev.org/65604707:35
*** gfidente|afk has quit IRC07:39
*** slaweq has quit IRC07:45
*** yamamoto has quit IRC07:47
*** yamamoto has joined #openstack-infra07:48
*** rcernin has joined #openstack-infra07:50
*** Lucas_Gray has joined #openstack-infra07:51
*** roman_g has joined #openstack-infra07:51
*** vkmc has quit IRC08:05
*** vkmc has joined #openstack-infra08:06
*** Lucas_Gray has quit IRC08:17
*** ricolin has joined #openstack-infra08:24
*** yamamoto has quit IRC08:39
*** yamamoto has joined #openstack-infra08:55
openstackgerritTobias Henkel proposed zuul/zuul master: Support fail-fast in project pipelines  https://review.opendev.org/65276409:06
*** yamamoto has quit IRC09:08
openstackgerritTobias Henkel proposed zuul/zuul master: Support emitting warnings via zuul_return  https://review.opendev.org/65152609:08
openstackgerritTobias Henkel proposed zuul/zuul master: Fix test race in test_provides_requires_pause  https://review.opendev.org/65605109:17
openstackgerritTobias Henkel proposed zuul/zuul master: DNM: exercise halving concurrency  https://review.opendev.org/65580509:20
*** bhavikdbavishi has joined #openstack-infra09:24
openstackgerritMerged zuul/zuul master: Clarify .zuul.d directory  https://review.opendev.org/65364409:44
*** yamamoto has joined #openstack-infra09:50
*** yamamoto has quit IRC09:57
openstackgerritMerged zuul/zuul master: Fix test race in test_job_pause  https://review.opendev.org/65602410:17
*** slaweq has joined #openstack-infra10:51
*** e0ne has joined #openstack-infra11:41
*** lpetrut has quit IRC11:44
*** roman_g has quit IRC11:45
*** e0ne has quit IRC11:48
*** smarcet has joined #openstack-infra11:51
*** lpetrut has joined #openstack-infra12:00
*** e0ne has joined #openstack-infra12:02
*** psachin has joined #openstack-infra12:10
*** smarcet has quit IRC12:11
*** e0ne has quit IRC12:33
*** yamamoto has joined #openstack-infra12:49
*** pabelanger has joined #openstack-infra12:49
*** yamamoto has quit IRC12:52
*** ricolin has quit IRC12:52
*** yamamoto has joined #openstack-infra13:00
*** e0ne has joined #openstack-infra13:00
*** smarcet has joined #openstack-infra13:03
*** markvoelker has quit IRC13:05
*** jbadiapa has quit IRC13:06
mnaserI expect most people are traveling but13:10
*** smarcet has quit IRC13:10
mnaserI just saw an ovh-gra1 job fail with: Failed to connect to 2001:4800:7817:103:be76:4eff:fe04:e3e3: Network is unreachable13:10
clarkbmnaser: any idea what the context is? we dont have worling ipv6 there so that is expectedaiui13:11
clarkband ya plane boards in a few minutes so not terribly useful today :)13:11
mnaserclarkb: looks like the refresh part failed first -- http://logs.openstack.org/81/650481/2/check/openstack-ansible-deploy-aio_distro_metal-centos-7/019788f/job-output.txt.gz#_2019-04-27_09_05_56_65604413:12
mnaser2019-04-27 09:09:35.174066 | centos-7 | http://mirror.gra1.ovh.openstack.org/centos/7/os/x86_64/repodata/repomd.xml: [Errno 12] Timeout on http://mirror.gra1.ovh.openstack.org/centos/7/os/x86_64/repodata/repomd.xml: (28, 'Connection timed out after 30001 milliseconds')13:12
mnaserand our git clones are failing on that m machine after13:12
mnaser2019-04-27 12:01:11.009636 | centos-7 | failed: [localhost] (item={'scm': u'git', 'src': u'https://git.openstack.org/openstack/openstack-ansible-os_panko', 'version': u'master', 'name': u'os_panko', 'trackbranch': u'master'}) => {"attempts": 2, "changed": false, "cmd": "/usr/bin/git clone --origin origin https://git.openstack.org/openstack/openstack-ansible-os_panko /etc/ansible/roles/os_panko", "item": {"name":13:12
mnaser"os_panko", "scm": "git", "src": "https://git.openstack.org/openstack/openstack-ansible-os_panko", "trackbranch": "master", "version": "master"}, "msg": "fatal: unable to access 'https://git.openstack.org/openstack/openstack-ansible-os_panko/': Failed to connect to 2604:e100:3:0:f816:3eff:fe6b:ad62: Network is unreachable", "rc": 128, "stderr": "fatal: unable to access13:12
mnaser'https://git.openstack.org/openstack/openstack-ansible-os_panko/': Failed to connect to 2604:e100:3:0:f816:3eff:fe6b:ad62: Network is unreachable\n", "stderr_lines": ["fatal: unable to access 'https://git.openstack.org/openstack/openstack-ansible-os_panko/': Failed to connect to 2604:e100:3:0:f816:3eff:fe6b:ad62: Network is unreachable"], "stdout": "Cloning into '/etc/ansible/roles/os_panko'...\n", "stdout_lines":13:12
mnaser["Cloning into '/etc/ansible/roles/os_panko'..."]}13:12
mnaserwhoops, didn't think that would end up in 4 messages.13:12
clarkbok so it is trying to ipv6 to the git server. Itahouldnt do that aiui13:14
clarkbunless ipv6 info now ends up in the config drive there13:14
mnaserweird13:15
mnaserit only seems to have a link local ipv6 adress13:15
mnaserhttp://logs.openstack.org/81/650481/2/check/openstack-ansible-deploy-aio_distro_metal-centos-7/019788f/zuul-info/host-info.centos-7.yaml13:15
mnaserhttp://logs.openstack.org/81/650481/2/check/openstack-ansible-deploy-aio_distro_metal-centos-7/019788f/zuul-info/zuul-info.centos-7.txt routing table seems like it should complain13:16
mnaserI think the. networking is just. f'd on this vm13:17
clarkbrogue router advertisement after fact gathering maybe?13:17
mnaserbecause it's unable to reach the mirrors properly13:17
mnaserand those only resolve to ipv4 only13:17
clarkbah ya if thoseare v4 only too then likely broken networking entirely13:18
* mnaser shrugs. and hits "recheck" button13:18
*** e0ne has quit IRC13:18
mnaserhave a safe flight clarkb !13:18
clarkbthanks13:19
*** yamamoto has quit IRC13:20
*** samueldmq has joined #openstack-infra13:25
openstackgerritPaul Belanger proposed zuul/zuul master: Increase timeout value for test_playbook timeout job  https://review.opendev.org/65605813:26
*** adriant has quit IRC13:27
*** bhavikdbavishi has quit IRC13:29
*** bhavikdbavishi has joined #openstack-infra13:31
*** e0ne has joined #openstack-infra13:32
*** e0ne has quit IRC13:37
*** jamesmcarthur has joined #openstack-infra13:45
openstackgerritMerged zuul/zuul master: Fix test race in test_provides_requires_pause  https://review.opendev.org/65605113:47
openstackgerritPaul Belanger proposed zuul/zuul master: DNM: exercise halving concurrency  https://review.opendev.org/65580513:52
*** shardy has quit IRC14:01
*** yamamoto has joined #openstack-infra14:02
*** shardy has joined #openstack-infra14:02
*** jamesmcarthur has quit IRC14:07
*** sshnaidm has joined #openstack-infra14:15
*** psachin has quit IRC14:30
*** slaweq has quit IRC14:36
openstackgerritMerged zuul/zuul master: Add more debugging to tests  https://review.opendev.org/65600614:38
*** sshnaidm has quit IRC14:44
*** sshnaidm has joined #openstack-infra14:44
*** sshnaidm is now known as sshnaidm|off14:44
fungimnaser: i've seen git try ipv6 after an ipv4 connection fails, even if there is no global v6 route. in those cases the error is misleading and actually means it failed to establish a connection over ipv414:45
fungi(but it's masked by the subsequent retry over broken/nonexistent v6)14:45
*** bhavikdbavishi has quit IRC14:49
*** dklyle has quit IRC14:55
mnaserfungi: that makes a lot of sense then, given the other failures it saw trying to contact the mirror14:55
fungiso, yeah, probably general network connectivity issues for that node14:56
*** ijw has joined #openstack-infra14:59
*** whoami-rajat has quit IRC15:05
*** gmann has joined #openstack-infra15:06
*** sshnaidm|off has quit IRC15:10
*** ijw has quit IRC15:11
*** bhavikdbavishi has joined #openstack-infra15:11
*** kazsh has quit IRC15:24
*** kazsh has joined #openstack-infra15:25
openstackgerritMerged zuul/zuul master: Increase timeout value for test_playbook timeout job  https://review.opendev.org/65605815:30
*** michael-beaver has joined #openstack-infra15:32
*** lseki has joined #openstack-infra15:49
*** yamamoto has quit IRC15:52
*** samueldmq has quit IRC15:53
*** ykarel|away has quit IRC15:56
*** bhavikdbavishi has quit IRC16:02
*** bhavikdbavishi has joined #openstack-infra16:03
*** gfidente has joined #openstack-infra16:04
*** bnemec has joined #openstack-infra16:09
openstackgerritPaul Belanger proposed zuul/zuul master: Fix test race in test_job_pause (#2)  https://review.opendev.org/65607216:19
openstackgerritPaul Belanger proposed zuul/zuul master: Fix test race in test_job_pause_retry (#2)  https://review.opendev.org/65607216:21
openstackgerritPaul Belanger proposed zuul/zuul master: DNM: exercise halving concurrency  https://review.opendev.org/65580516:22
*** Goneri has joined #openstack-infra16:50
*** pcaruana has joined #openstack-infra16:54
*** bhavikdbavishi has quit IRC16:56
*** bhavikdbavishi has joined #openstack-infra17:03
*** Goneri has quit IRC17:11
*** markvoelker has joined #openstack-infra17:12
*** yamamoto has joined #openstack-infra17:12
*** dklyle has joined #openstack-infra17:15
*** yamamoto has quit IRC17:19
SpamapSinfra-root not sure if y'all had a chance to see this: https://www.zdnet.com/google-amp/article/docker-hub-hack-exposed-data-of-190000-users/17:37
*** michael-beaver has quit IRC17:42
*** lpetrut has quit IRC17:49
*** lpetrut has joined #openstack-infra18:04
*** Lucas_Gray has joined #openstack-infra18:08
fungiyikes18:19
fungii had not, just had a few minutes to hop online during a layover18:19
fungiat least i think we don't configure dockerhub to authenticate to any other services, so at worst we just need to reset passwords and double-check that nothing was uploaded outside zuul jobs18:20
fungii haven't seen any notifications from dockerhub yet, so possible our accounts were not part of the "lucky" 5%18:21
*** lseki has quit IRC18:41
*** Lucas_Gray has quit IRC18:44
*** whoami-rajat has joined #openstack-infra18:45
*** bhavikdbavishi has quit IRC18:46
openstackgerritPaul Belanger proposed zuul/zuul master: Make paused status bar blue  https://review.opendev.org/65558818:46
*** e0ne has joined #openstack-infra18:55
*** gmann has quit IRC18:56
*** e0ne has quit IRC18:59
openstackgerritPaul Belanger proposed zuul/zuul master: DNM: exercise halving concurrency  https://review.opendev.org/65580519:02
*** slaweq has joined #openstack-infra19:04
clarkbfor people flying into denver today the train the opemstack release is named after is free tpday19:05
clarkband will take you downtown to union station about a mile from the conference center19:05
clarkbthat is like 1.5km19:05
openstackgerritPaul Belanger proposed zuul/zuul master: Switch to zuul.opendev.org for dashboard-multi-tenant  https://review.opendev.org/65608319:08
*** rfolco|ruck has quit IRC19:24
clarkbmaybe dont take the train they are kicking us off and putting us on busses19:28
paladoxclarkb why would they kick you off? Too many people or are they closing that particular train?19:38
*** slaweq has quit IRC19:38
*** efried has quit IRC19:42
clarkbI think someone jumped on the tracks on a train ahead of us19:42
openstackgerritPaul Belanger proposed zuul/zuul master: Switch to zuul.opendev.org for dashboard-multi-tenant  https://review.opendev.org/65608319:48
paladoxoh19:57
*** slaweq has joined #openstack-infra20:00
*** slaweq has quit IRC20:09
*** markvoelker has quit IRC20:13
*** rfolco|ruck has joined #openstack-infra20:22
*** altlogbot_0 has quit IRC20:43
*** altlogbot_0 has joined #openstack-infra20:44
openstackgerritMerged openstack/ptgbot master: Switch example IRC port to 6697  https://review.opendev.org/65597621:10
openstackgerritMerged openstack/ptgbot master: Change OpenStack to Open Infrastructure in README.rst title  https://review.opendev.org/65597721:11
*** markvoelker has joined #openstack-infra21:14
*** pcaruana has quit IRC21:23
*** gmann has joined #openstack-infra21:28
*** sshnaidm|off has joined #openstack-infra22:12
*** jamesmcarthur has joined #openstack-infra22:19
*** diablo_rojo has joined #openstack-infra22:20
*** hwoarang has quit IRC22:24
*** hwoarang has joined #openstack-infra22:26
*** diablo_rojo has quit IRC22:28
*** diablo_rojo has joined #openstack-infra22:30
*** jamesmcarthur has quit IRC22:51
*** jamesmcarthur has joined #openstack-infra22:53
*** lpetrut has quit IRC22:56
*** diablo_rojo has quit IRC23:01
*** jamesmcarthur has quit IRC23:02
*** jamesmcarthur has joined #openstack-infra23:02
*** jamesmcarthur has quit IRC23:04
*** bobh has joined #openstack-infra23:23
*** whoami-rajat has quit IRC23:25
fungithe airport had a "train" from my arrival terminal to the ground transportation area, so i'm counting that as my commemorative train ride. i simply took a taxi to the hotel23:43
fungithough there's apparently some professional basketball championship here tonight, so traffic downtown is pretty bad as well23:43

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!