*** jamesdenton has joined #openstack-infra | 00:00 | |
*** dingyichen has joined #openstack-infra | 00:01 | |
*** thorst has joined #openstack-infra | 00:02 | |
mriedem | got a really weird job failure here http://logs.openstack.org/97/482497/1/gate/gate-nova-pep8-ubuntu-xenial/c8c6067/console.html#_2017-07-12_18_48_34_214565 | 00:04 |
---|---|---|
*** dhajare has joined #openstack-infra | 00:04 | |
mriedem | pep8 was fine | 00:04 |
*** gildub has joined #openstack-infra | 00:04 | |
*** xyang1 has quit IRC | 00:05 | |
pabelanger | mriedem: job timeout | 00:06 |
mriedem | oh | 00:06 |
pabelanger | mriedem: it was around the time out zuul-launcher were over subscribed | 00:06 |
pabelanger | mriedem: we've added 2 more launchers today to help fix that moving forward | 00:06 |
mriedem | ok, cool | 00:07 |
mriedem | just checking | 00:07 |
pabelanger | np | 00:07 |
mriedem | i did see the spike in the zuul job queue on the status page | 00:07 |
pabelanger | okay, I am going to start zl08.o.o again, nodepool.yaml has been updated | 00:07 |
*** thorst has quit IRC | 00:07 | |
pabelanger | mriedem: ya, were maxed out all our clouds this afternoon | 00:08 |
*** dave-mccowan has joined #openstack-infra | 00:09 | |
*** gmann has quit IRC | 00:11 | |
*** gmann has joined #openstack-infra | 00:11 | |
pabelanger | okay, zl08.o.o back online | 00:13 |
pabelanger | its been properly assigned jobs this time | 00:13 |
pabelanger | moving to zl09 now | 00:14 |
pabelanger | and online | 00:16 |
pabelanger | #status log zl08.o.o and zl09.o.o are now online and functional. | 00:17 |
openstackstatus | pabelanger: finished logging | 00:17 |
*** Apoorva has quit IRC | 00:17 | |
*** askb has joined #openstack-infra | 00:19 | |
*** Apoorva has joined #openstack-infra | 00:21 | |
openstackgerrit | John L. Villalovos proposed openstack-infra/devstack-gate master: Add ironic-inspector services to features.yaml https://review.openstack.org/483059 | 00:22 |
openstackgerrit | John L. Villalovos proposed openstack-infra/devstack-gate master: WIP: Test patch to see if fixes ironic-inspector grenade https://review.openstack.org/483065 | 00:22 |
*** makowals has joined #openstack-infra | 00:22 | |
*** wolverineav has quit IRC | 00:22 | |
*** jamesdenton has quit IRC | 00:24 | |
*** dhajare has quit IRC | 00:25 | |
*** slaweq_ has joined #openstack-infra | 00:26 | |
*** jamesdenton has joined #openstack-infra | 00:27 | |
*** wolverineav has joined #openstack-infra | 00:30 | |
*** slaweq_ has quit IRC | 00:30 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Make roles ordered https://review.openstack.org/483140 | 00:34 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Run playbooks with only those roles defined thus far https://review.openstack.org/483141 | 00:34 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add child roles before parent https://review.openstack.org/483142 | 00:34 |
*** markvoelker has quit IRC | 00:35 | |
*** wolverineav has quit IRC | 00:36 | |
*** jamesdenton has quit IRC | 00:37 | |
*** ihrachys has quit IRC | 00:37 | |
*** zhurong has joined #openstack-infra | 00:37 | |
*** wolverineav has joined #openstack-infra | 00:37 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Run playbooks with only those roles defined thus far https://review.openstack.org/483141 | 00:39 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add child roles before parent https://review.openstack.org/483142 | 00:39 |
jeblair | pabelanger: thanks! | 00:39 |
*** LindaWang has joined #openstack-infra | 00:44 | |
*** cuongnv has joined #openstack-infra | 00:46 | |
*** baoli has joined #openstack-infra | 00:46 | |
*** markvoelker has joined #openstack-infra | 00:47 | |
*** baoli has quit IRC | 00:51 | |
*** bobh has quit IRC | 00:52 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Fix website style per openstackdocstheme changes https://review.openstack.org/482215 | 00:52 |
*** wolverineav has quit IRC | 00:56 | |
*** wolverineav has joined #openstack-infra | 01:02 | |
*** ihrachys has joined #openstack-infra | 01:02 | |
*** gouthamr has quit IRC | 01:05 | |
*** makowals has quit IRC | 01:06 | |
*** ihrachys has quit IRC | 01:11 | |
*** wolverineav has quit IRC | 01:14 | |
*** sflanigan has quit IRC | 01:17 | |
*** prateek has quit IRC | 01:19 | |
*** amotoki_away is now known as amotoki | 01:19 | |
*** wolverineav has joined #openstack-infra | 01:25 | |
*** slaweq_ has joined #openstack-infra | 01:26 | |
*** liujiong has joined #openstack-infra | 01:26 | |
*** cshastri has joined #openstack-infra | 01:29 | |
openstackgerrit | Kien Nguyen proposed openstack-infra/project-config master: Setup multinode CI for Zun https://review.openstack.org/482877 | 01:29 |
*** sflanigan has joined #openstack-infra | 01:30 | |
*** ihrachys has joined #openstack-infra | 01:30 | |
*** slaweq_ has quit IRC | 01:31 | |
*** wolverineav has quit IRC | 01:36 | |
*** bobh has joined #openstack-infra | 01:37 | |
*** wolverineav has joined #openstack-infra | 01:39 | |
*** Apoorva_ has joined #openstack-infra | 01:40 | |
*** baoli has joined #openstack-infra | 01:40 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Add a new docker centos Heat environment https://review.openstack.org/479399 | 01:42 |
*** Apoorva has quit IRC | 01:44 | |
*** Apoorva_ has quit IRC | 01:44 | |
*** gcb has joined #openstack-infra | 01:44 | |
*** jascott1_ has joined #openstack-infra | 01:46 | |
*** jascott1 has quit IRC | 01:48 | |
*** wolverineav has quit IRC | 01:53 | |
openstackgerrit | Kien Nguyen proposed openstack-infra/project-config master: Add Heat grenade mutlinode gate job https://review.openstack.org/482048 | 01:54 |
*** wolverineav has joined #openstack-infra | 01:54 | |
*** wolverineav has quit IRC | 01:59 | |
*** hongbin has joined #openstack-infra | 01:59 | |
*** weshay is now known as weshay_pto | 02:01 | |
*** gyee has quit IRC | 02:02 | |
*** wolverineav has joined #openstack-infra | 02:03 | |
*** mwarad has joined #openstack-infra | 02:07 | |
*** sflanigan has quit IRC | 02:07 | |
*** wolverineav has quit IRC | 02:08 | |
*** amotoki is now known as amotoki_away | 02:08 | |
*** gagehugo has quit IRC | 02:08 | |
*** thorst has joined #openstack-infra | 02:08 | |
*** gagehugo has joined #openstack-infra | 02:11 | |
*** ramishra has joined #openstack-infra | 02:13 | |
*** thorst has quit IRC | 02:13 | |
*** wolverineav has joined #openstack-infra | 02:15 | |
*** bobh_ has joined #openstack-infra | 02:18 | |
*** baoli has quit IRC | 02:18 | |
*** bobh has quit IRC | 02:19 | |
*** wolverineav has quit IRC | 02:20 | |
*** sflanigan has joined #openstack-infra | 02:20 | |
*** sflanigan has joined #openstack-infra | 02:20 | |
*** baoli has joined #openstack-infra | 02:22 | |
*** mriedem is now known as mriedem_away | 02:23 | |
*** rlandy|bbl is now known as rlandy | 02:27 | |
*** slaweq_ has joined #openstack-infra | 02:27 | |
*** wolverineav has joined #openstack-infra | 02:28 | |
*** tjones has left #openstack-infra | 02:28 | |
*** wolverineav has quit IRC | 02:32 | |
*** slaweq_ has quit IRC | 02:33 | |
*** tuanluong has joined #openstack-infra | 02:35 | |
*** hongbin_ has joined #openstack-infra | 02:37 | |
*** hongbin has quit IRC | 02:39 | |
*** makowals has joined #openstack-infra | 02:43 | |
*** wolverineav has joined #openstack-infra | 02:46 | |
*** baoli has quit IRC | 02:46 | |
*** mriedem_away has quit IRC | 02:47 | |
*** baoli has joined #openstack-infra | 02:49 | |
*** wolverineav has quit IRC | 02:50 | |
*** yamahata has quit IRC | 02:52 | |
*** baoli has quit IRC | 02:52 | |
*** iyamahat_ has quit IRC | 02:52 | |
*** wolverineav has joined #openstack-infra | 02:57 | |
*** esberglu has joined #openstack-infra | 03:00 | |
*** esberglu has quit IRC | 03:00 | |
openstackgerrit | Sam Wan proposed openstack-infra/devstack-gate master: Only grab journal data since log-start-timestamp https://review.openstack.org/483165 | 03:00 |
*** shu-mutou has joined #openstack-infra | 03:00 | |
*** wolverineav has quit IRC | 03:01 | |
*** wolverineav has joined #openstack-infra | 03:08 | |
*** bobh_ has quit IRC | 03:10 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: Fix status_url section in zuul.conf-sample https://review.openstack.org/483166 | 03:11 |
*** wolverineav has quit IRC | 03:13 | |
*** hongbin_ has quit IRC | 03:16 | |
*** yamahata has joined #openstack-infra | 03:17 | |
*** ykarel has joined #openstack-infra | 03:18 | |
*** wolverineav has joined #openstack-infra | 03:19 | |
*** bobh has joined #openstack-infra | 03:21 | |
*** makowals has quit IRC | 03:22 | |
*** dave-mccowan has quit IRC | 03:24 | |
*** wolverineav has quit IRC | 03:24 | |
*** jerryz has quit IRC | 03:25 | |
*** amotoki_away is now known as amotoki | 03:25 | |
*** slaweq_ has joined #openstack-infra | 03:29 | |
*** wolverineav has joined #openstack-infra | 03:29 | |
*** hongbin has joined #openstack-infra | 03:32 | |
*** slaweq_ has quit IRC | 03:33 | |
*** jcoufal has joined #openstack-infra | 03:33 | |
*** wolverineav has quit IRC | 03:34 | |
*** bobh has quit IRC | 03:35 | |
*** prateek has joined #openstack-infra | 03:35 | |
*** hongbin has quit IRC | 03:41 | |
openstackgerrit | Sam Wan proposed openstack-infra/devstack-gate master: Only grab journal data since log-start-timestamp https://review.openstack.org/483165 | 03:44 |
*** vhosakot_ has joined #openstack-infra | 03:51 | |
*** esberglu has joined #openstack-infra | 03:53 | |
*** vhosakot has quit IRC | 03:54 | |
*** esberglu has quit IRC | 03:58 | |
*** MatthewLi1 has joined #openstack-infra | 04:00 | |
*** MatthewLi has quit IRC | 04:00 | |
*** MatthewLi1 is now known as MatthewLi | 04:00 | |
*** eranrom has quit IRC | 04:00 | |
*** xarses_ has joined #openstack-infra | 04:01 | |
*** links has joined #openstack-infra | 04:02 | |
*** xarses has quit IRC | 04:04 | |
*** jascott1_ has quit IRC | 04:05 | |
*** jascott1 has joined #openstack-infra | 04:05 | |
*** sflanigan has quit IRC | 04:06 | |
openstackgerrit | Steve Baker proposed openstack-infra/tripleo-ci master: Use prepare command to build container images env file https://review.openstack.org/483178 | 04:08 |
*** pahuang has quit IRC | 04:09 | |
*** jascott1 has quit IRC | 04:11 | |
*** ykarel_ has joined #openstack-infra | 04:13 | |
openstackgerrit | ChangBo Guo(gcb) proposed openstack-dev/pbr master: Update URLs in documents according to document migration https://review.openstack.org/483181 | 04:16 |
*** sflanigan has joined #openstack-infra | 04:23 | |
*** sflanigan has joined #openstack-infra | 04:23 | |
*** pahuang has joined #openstack-infra | 04:26 | |
*** felipemonteiro has joined #openstack-infra | 04:27 | |
*** slaweq_ has joined #openstack-infra | 04:30 | |
*** psachin has joined #openstack-infra | 04:31 | |
*** wolverineav has joined #openstack-infra | 04:34 | |
*** slaweq_ has quit IRC | 04:35 | |
*** claudiub has joined #openstack-infra | 04:36 | |
*** sree has joined #openstack-infra | 04:36 | |
*** jcoufal has quit IRC | 04:38 | |
*** wolverineav has quit IRC | 04:41 | |
*** wolverineav has joined #openstack-infra | 04:50 | |
*** mwarad has quit IRC | 04:50 | |
*** baoli has joined #openstack-infra | 04:53 | |
*** pratik has joined #openstack-infra | 04:56 | |
*** ihrachys has quit IRC | 04:57 | |
*** baoli has quit IRC | 04:58 | |
openstackgerrit | Pratik Shah proposed openstack-infra/project-config master: Added changes to run unit tests for Omni project using Zuul https://review.openstack.org/475300 | 04:59 |
*** wolverineav has quit IRC | 04:59 | |
openstackgerrit | Tony Breeds proposed openstack-infra/system-config master: owners.py: Use bytes when calling mktrans for python3 https://review.openstack.org/483188 | 05:00 |
*** felipemonteiro has quit IRC | 05:01 | |
*** armax has quit IRC | 05:01 | |
*** armax has joined #openstack-infra | 05:01 | |
*** armax has quit IRC | 05:02 | |
*** armax has joined #openstack-infra | 05:02 | |
*** armax has quit IRC | 05:03 | |
*** armax has joined #openstack-infra | 05:03 | |
*** armax has quit IRC | 05:03 | |
*** armax has joined #openstack-infra | 05:04 | |
*** armax has quit IRC | 05:04 | |
*** makowals has joined #openstack-infra | 05:05 | |
*** wolverineav has joined #openstack-infra | 05:06 | |
*** jtomasek_ has joined #openstack-infra | 05:07 | |
*** rlandy has quit IRC | 05:07 | |
*** slaweq_ has joined #openstack-infra | 05:09 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: Fix status_url section in zuul.conf-sample https://review.openstack.org/483166 | 05:09 |
*** slaweq_ has quit IRC | 05:11 | |
*** wolverineav has quit IRC | 05:11 | |
*** psachin has quit IRC | 05:12 | |
*** psachin has joined #openstack-infra | 05:15 | |
*** wolverineav has joined #openstack-infra | 05:16 | |
*** bhavik1 has joined #openstack-infra | 05:17 | |
*** rlandy has joined #openstack-infra | 05:18 | |
*** dhajare has joined #openstack-infra | 05:21 | |
*** wolverineav has quit IRC | 05:23 | |
*** jtomasek has quit IRC | 05:23 | |
*** sflanigan has quit IRC | 05:24 | |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add spacing lines and formatting to result dicts https://review.openstack.org/483042 | 05:24 |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add play recap back in to the end of plays https://review.openstack.org/483043 | 05:24 |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Log execution phase and include information https://review.openstack.org/483044 | 05:30 |
*** jtomasek_ has quit IRC | 05:31 | |
*** gouthamr has joined #openstack-infra | 05:34 | |
*** sflanigan has joined #openstack-infra | 05:36 | |
*** sflanigan has joined #openstack-infra | 05:36 | |
*** marst has joined #openstack-infra | 05:36 | |
pratik | AJaeger: Hi, is anything pending to merge the patch https://review.openstack.org/#/c/475300/? | 05:36 |
*** wolverineav has joined #openstack-infra | 05:37 | |
*** rcernin has joined #openstack-infra | 05:40 | |
*** wolverineav has quit IRC | 05:42 | |
*** cuongnv has quit IRC | 05:45 | |
*** tuanluong has quit IRC | 05:45 | |
*** tuanluong has joined #openstack-infra | 05:46 | |
*** cuongnv has joined #openstack-infra | 05:46 | |
*** pgadiya has joined #openstack-infra | 05:53 | |
AJaeger | pratik: each change needs two core reviewers to +2 - does it have those two already? | 05:57 |
*** thorst has joined #openstack-infra | 05:57 | |
AJaeger | pratik: why are you rebasing that change? That# | 05:58 |
AJaeger | That'S absolutely not necessary and might make reviewing harder - and just wastes resources. We automatically rebase when merging... | 05:58 |
*** wolverineav has joined #openstack-infra | 06:00 | |
*** thorst has quit IRC | 06:03 | |
*** wolverineav has quit IRC | 06:05 | |
pratik | AJaeger: it doesn't have two +2 | 06:05 |
*** wolverineav has joined #openstack-infra | 06:08 | |
*** dhajare has quit IRC | 06:09 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: Add /etc/hosts and /etc/nsswitch.conf to the bubblewrap https://review.openstack.org/483210 | 06:10 |
*** slaweq_ has joined #openstack-infra | 06:11 | |
*** wolverineav has quit IRC | 06:13 | |
openstackgerrit | Merged openstack-infra/project-config master: Pass environment variables of proxy to tox https://review.openstack.org/482067 | 06:14 |
*** slaweq_ has quit IRC | 06:16 | |
*** slaweq_ has joined #openstack-infra | 06:19 | |
AJaeger | pratik: ok, then, please have patience and wait for others to review. project-config has too few reviewers and many chnges... | 06:19 |
*** wolverineav has joined #openstack-infra | 06:21 | |
*** slaweq_ has quit IRC | 06:24 | |
*** wolverineav has quit IRC | 06:26 | |
*** wolverineav has joined #openstack-infra | 06:26 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: Add /etc/hosts and /etc/nsswitch.conf to the bubblewrap https://review.openstack.org/483210 | 06:30 |
*** d0ugal has quit IRC | 06:33 | |
*** florianf has joined #openstack-infra | 06:36 | |
*** wolverineav has quit IRC | 06:37 | |
*** esberglu has joined #openstack-infra | 06:37 | |
*** dhajare has joined #openstack-infra | 06:38 | |
*** esberglu has quit IRC | 06:38 | |
*** esberglu has joined #openstack-infra | 06:38 | |
*** esberglu has quit IRC | 06:38 | |
openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config master: tap-as-a-service: Add releasenotes job https://review.openstack.org/483214 | 06:40 |
*** eranrom has joined #openstack-infra | 06:47 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/project-config master: Make puppet-openstackci beaker jobs voting https://review.openstack.org/482938 | 06:50 |
*** pratik has quit IRC | 06:50 | |
*** isaacb has joined #openstack-infra | 06:52 | |
*** pcaruana has joined #openstack-infra | 06:52 | |
*** tesseract has joined #openstack-infra | 06:56 | |
*** electrofelix has joined #openstack-infra | 06:57 | |
*** ccamacho has joined #openstack-infra | 06:58 | |
*** vhosakot_ has quit IRC | 07:01 | |
*** sree_ has joined #openstack-infra | 07:01 | |
*** sree_ is now known as Guest93990 | 07:02 | |
*** pahuang has quit IRC | 07:02 | |
*** sree has quit IRC | 07:05 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix KeysView object does not support indexing https://review.openstack.org/483231 | 07:06 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix dictionary change during iteration https://review.openstack.org/483232 | 07:06 |
*** wolverineav has joined #openstack-infra | 07:09 | |
*** d0ugal has joined #openstack-infra | 07:09 | |
*** eranrom has quit IRC | 07:12 | |
*** d0ugal has quit IRC | 07:18 | |
*** slaweq_ has joined #openstack-infra | 07:20 | |
*** gouthamr has quit IRC | 07:22 | |
*** wolverineav has quit IRC | 07:24 | |
*** isaacb_ has joined #openstack-infra | 07:24 | |
*** nicolasbock has joined #openstack-infra | 07:24 | |
*** slaweq_ has quit IRC | 07:24 | |
*** alexchadin has joined #openstack-infra | 07:25 | |
*** isaacb has quit IRC | 07:26 | |
*** isaacb_ has quit IRC | 07:29 | |
*** isaacb_ has joined #openstack-infra | 07:35 | |
*** daidv__ has joined #openstack-infra | 07:36 | |
*** andreas_s has joined #openstack-infra | 07:36 | |
*** wolverineav has joined #openstack-infra | 07:36 | |
daidv__ | Hi, anyone around? | 07:37 |
*** tuanluong has quit IRC | 07:37 | |
*** jpich has joined #openstack-infra | 07:38 | |
daidv__ | I saw too many gate related to dpkg-debian is failed | 07:38 |
daidv__ | And have the same problem like | 07:39 |
daidv__ | sudo sed -i s/httpredir.debian.org/ftp.us.debian.org/ /etc/apt/sources.list | 07:39 |
daidv__ | sed: can't read /etc/apt/sources.list: No such file or directory" | 07:39 |
daidv__ | #link https://review.openstack.org/#/q/dpkg-debian | 07:39 |
daidv__ | Sorry about that I don't know where should I report this bug. | 07:41 |
*** wolverineav has quit IRC | 07:41 | |
*** dizquierdo has joined #openstack-infra | 07:44 | |
*** wolverineav has joined #openstack-infra | 07:45 | |
*** ralonsoh has joined #openstack-infra | 07:46 | |
*** egonzalez has joined #openstack-infra | 07:47 | |
*** nicolasbock has quit IRC | 07:50 | |
*** wolverineav has quit IRC | 07:51 | |
aarefiev | morning! cores, could you help with https://review.openstack.org/#/c/483058/1 https://review.openstack.org/#/c/483059/4 please | 07:52 |
*** shardy has joined #openstack-infra | 07:52 | |
aarefiev | we are blocked now | 07:52 |
*** rossella_s has joined #openstack-infra | 07:53 | |
*** rossella_s has quit IRC | 07:53 | |
*** rossella_s has joined #openstack-infra | 07:54 | |
*** wolverineav has joined #openstack-infra | 07:57 | |
*** rossella_s has quit IRC | 07:59 | |
*** thorst has joined #openstack-infra | 07:59 | |
*** rossella_s has joined #openstack-infra | 08:01 | |
*** sergK_ has joined #openstack-infra | 08:01 | |
*** wolverineav has quit IRC | 08:02 | |
*** thorst has quit IRC | 08:03 | |
*** askb has quit IRC | 08:04 | |
*** markvoelker has quit IRC | 08:08 | |
*** ralonsoh has quit IRC | 08:09 | |
*** sflanigan has quit IRC | 08:09 | |
*** ralonsoh_ has joined #openstack-infra | 08:09 | |
*** jascott1 has joined #openstack-infra | 08:09 | |
AJaeger | aarefiev: those change miss review by the ironic infra liasion - see https://wiki.openstack.org/wiki/CrossProjectLiaisons#Infra . best ask your team for review first... | 08:10 |
aarefiev | AJaeger: thanks, we asked already, waiting ... | 08:14 |
*** gildub has quit IRC | 08:14 | |
*** lucas-afk is now known as lucasagomes | 08:15 | |
*** jascott1 has quit IRC | 08:15 | |
*** wolverineav has joined #openstack-infra | 08:15 | |
*** jbadiapa_ is now known as jbadiapa | 08:18 | |
openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config master: aodh: remove obsolete functional tests https://review.openstack.org/483258 | 08:18 |
*** wolverineav has quit IRC | 08:21 | |
*** slaweq_ has joined #openstack-infra | 08:21 | |
*** wolverineav has joined #openstack-infra | 08:24 | |
*** rossella_s has quit IRC | 08:25 | |
*** slaweq_ has quit IRC | 08:25 | |
*** alexchadin has quit IRC | 08:29 | |
*** yland has joined #openstack-infra | 08:29 | |
*** yland is now known as Guest36023 | 08:29 | |
*** eranrom has joined #openstack-infra | 08:34 | |
*** jtomasek_ has joined #openstack-infra | 08:34 | |
*** slaweq_ has joined #openstack-infra | 08:34 | |
*** wolverineav has quit IRC | 08:35 | |
*** ralonsoh_ is now known as ralonsoh | 08:37 | |
*** rossella_s has joined #openstack-infra | 08:38 | |
*** e0ne has joined #openstack-infra | 08:38 | |
*** sbezverk has quit IRC | 08:39 | |
*** raissa_ has joined #openstack-infra | 08:39 | |
*** d0ugal has joined #openstack-infra | 08:41 | |
*** florianf has quit IRC | 08:45 | |
*** wolverineav has joined #openstack-infra | 08:49 | |
*** eranrom has quit IRC | 08:49 | |
hwoarang | good morning | 08:50 |
hwoarang | could i request access to one of the CI nodes to investigate some openSUSE job failures? I can't reproduce them locally | 08:50 |
*** dtantsur|afk is now known as dtantsur | 08:52 | |
*** dingyichen has quit IRC | 08:56 | |
*** florianf has joined #openstack-infra | 08:58 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: calculate and record the size of the log files for tripleo-ci https://review.openstack.org/481727 | 08:58 |
*** alexchadin has joined #openstack-infra | 08:58 | |
*** Douhet has quit IRC | 09:00 | |
*** MatthewLi has quit IRC | 09:01 | |
*** MatthewLi1 has joined #openstack-infra | 09:01 | |
*** wolverineav has quit IRC | 09:01 | |
*** eranrom has joined #openstack-infra | 09:02 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz collect data https://review.openstack.org/474559 | 09:03 |
*** MatthewLi1 is now known as MatthewLi | 09:03 | |
*** efoley has joined #openstack-infra | 09:05 | |
*** efoley has quit IRC | 09:05 | |
*** efoley has joined #openstack-infra | 09:05 | |
*** wolverineav has joined #openstack-infra | 09:07 | |
*** s-shiono has quit IRC | 09:09 | |
*** eranrom has quit IRC | 09:10 | |
*** wolverineav has quit IRC | 09:11 | |
*** tosky has joined #openstack-infra | 09:12 | |
openstackgerrit | Merged openstack-infra/project-config master: ironic: Add DEVSTACK_GATE_IRONIC_INSPECTOR=1 for inspector jobs https://review.openstack.org/483058 | 09:12 |
openstackgerrit | Merged openstack-infra/project-config master: Split Neutron check queue grafana dashboard https://review.openstack.org/483119 | 09:13 |
openstackgerrit | Merged openstack-infra/project-config master: enable py35 gate for congress-dashboard https://review.openstack.org/483076 | 09:13 |
openstackgerrit | Merged openstack-infra/project-config master: Setup multinode CI for Zun https://review.openstack.org/482877 | 09:13 |
openstackgerrit | Merged openstack-infra/project-config master: Added changes to run unit tests for Omni project using Zuul https://review.openstack.org/475300 | 09:13 |
*** d0ugal has quit IRC | 09:15 | |
openstackgerrit | Thierry Carrez proposed openstack-infra/devstack-gate master: Set up stable/pike https://review.openstack.org/483274 | 09:16 |
*** wolverineav has joined #openstack-infra | 09:16 | |
*** eranrom has joined #openstack-infra | 09:17 | |
*** eranrom has quit IRC | 09:21 | |
*** eranrom has joined #openstack-infra | 09:22 | |
*** winggundamth has joined #openstack-infra | 09:22 | |
openstackgerrit | Merged openstack-infra/project-config master: Add NODEPOOL_TARBALLS_PROXY to configure_mirror.sh https://review.openstack.org/483006 | 09:22 |
*** sambetts_ is now known as sambetts | 09:23 | |
*** wolverineav has quit IRC | 09:24 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Document start day of week https://review.openstack.org/483279 | 09:26 |
*** florianf has quit IRC | 09:29 | |
*** tuanluong has joined #openstack-infra | 09:32 | |
*** florianf has joined #openstack-infra | 09:34 | |
*** pgadiya has quit IRC | 09:35 | |
openstackgerrit | Gael Chamoulaud proposed openstack-infra/tripleo-ci master: WIP: Enable tripleo-validations tests https://review.openstack.org/481080 | 09:35 |
*** slaweq_ has joined #openstack-infra | 09:35 | |
*** slaweq_ has quit IRC | 09:40 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 09:41 |
*** liusheng has quit IRC | 09:43 | |
*** liusheng has joined #openstack-infra | 09:44 | |
*** liusheng has quit IRC | 09:44 | |
*** liusheng has joined #openstack-infra | 09:45 | |
*** rossella_s has quit IRC | 09:51 | |
*** thorst has joined #openstack-infra | 10:00 | |
*** mat128 has joined #openstack-infra | 10:03 | |
*** thorst has quit IRC | 10:04 | |
*** sshnaidm|afk is now known as sshnaidm | 10:05 | |
*** rossella_s has joined #openstack-infra | 10:05 | |
*** alexchadin has quit IRC | 10:06 | |
*** markvoelker has joined #openstack-infra | 10:09 | |
*** rossella_ has joined #openstack-infra | 10:10 | |
*** amotoki is now known as amotoki_away | 10:10 | |
*** cuongnv has quit IRC | 10:11 | |
*** shu-mutou has quit IRC | 10:13 | |
*** rossella_s has quit IRC | 10:13 | |
*** Guest93990 has quit IRC | 10:16 | |
*** esberglu has joined #openstack-infra | 10:16 | |
*** esberglu has quit IRC | 10:16 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config master: Transit Heat convergence job to use quickstart https://review.openstack.org/483292 | 10:18 |
*** liujiong has quit IRC | 10:22 | |
*** sergK_ has quit IRC | 10:22 | |
*** nicolasbock has joined #openstack-infra | 10:25 | |
*** sergK_ has joined #openstack-infra | 10:28 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config master: Replace old OVB ceph jobs by new fs024 job https://review.openstack.org/483295 | 10:30 |
*** yamamoto has quit IRC | 10:31 | |
*** amotoki_away is now known as amotoki | 10:32 | |
*** rossella_ has quit IRC | 10:35 | |
*** jpich has quit IRC | 10:35 | |
*** slaweq_ has joined #openstack-infra | 10:36 | |
*** amotoki is now known as amotoki_away | 10:38 | |
*** jpich has joined #openstack-infra | 10:38 | |
*** bhavik1 has quit IRC | 10:39 | |
*** iyamahat has joined #openstack-infra | 10:39 | |
*** slaweq_ has quit IRC | 10:41 | |
*** yamahata has quit IRC | 10:41 | |
*** iyamahat has quit IRC | 10:42 | |
*** markvoelker has quit IRC | 10:43 | |
*** zhurong has quit IRC | 10:43 | |
*** rossella_ has joined #openstack-infra | 10:48 | |
*** amotoki_away is now known as amotoki | 10:49 | |
*** gcb has quit IRC | 10:52 | |
*** amotoki is now known as amotoki_away | 10:57 | |
*** mhickey has joined #openstack-infra | 10:58 | |
*** jamesdenton has joined #openstack-infra | 10:59 | |
*** thorst has joined #openstack-infra | 11:01 | |
*** jkilpatr has quit IRC | 11:01 | |
*** pgadiya has joined #openstack-infra | 11:03 | |
*** thorst has quit IRC | 11:05 | |
*** winggundamth has quit IRC | 11:09 | |
*** esberglu has joined #openstack-infra | 11:10 | |
*** jamesdenton has quit IRC | 11:12 | |
*** yamamoto has joined #openstack-infra | 11:13 | |
*** jamesdenton has joined #openstack-infra | 11:13 | |
*** esberglu has quit IRC | 11:14 | |
*** Guest36023 has quit IRC | 11:15 | |
*** thorst has joined #openstack-infra | 11:17 | |
*** yamamoto has quit IRC | 11:18 | |
*** amotoki_away is now known as amotoki | 11:21 | |
*** yamamoto has joined #openstack-infra | 11:21 | |
*** yamamoto has quit IRC | 11:26 | |
*** dprince has joined #openstack-infra | 11:27 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 11:29 |
*** Guest36023 has joined #openstack-infra | 11:31 | |
*** wolverineav has joined #openstack-infra | 11:34 | |
*** jamesden_ has joined #openstack-infra | 11:34 | |
*** jascott1 has joined #openstack-infra | 11:35 | |
*** ldnunes has joined #openstack-infra | 11:35 | |
*** yamamoto has joined #openstack-infra | 11:36 | |
*** dprince_ has joined #openstack-infra | 11:37 | |
*** slaweq_ has joined #openstack-infra | 11:37 | |
*** dprince_ has quit IRC | 11:37 | |
*** e0ne_ has joined #openstack-infra | 11:37 | |
*** jamesdenton has quit IRC | 11:37 | |
*** stakeda has quit IRC | 11:38 | |
*** e0ne has quit IRC | 11:39 | |
*** jkilpatr has joined #openstack-infra | 11:39 | |
*** yamamoto has quit IRC | 11:40 | |
*** markvoelker has joined #openstack-infra | 11:41 | |
*** florianf has quit IRC | 11:41 | |
*** jascott1 has quit IRC | 11:41 | |
*** d0ugal has joined #openstack-infra | 11:41 | |
*** slaweq_ has quit IRC | 11:42 | |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Fix KeysView object does not support indexing https://review.openstack.org/483231 | 11:44 |
*** dizquierdo has quit IRC | 11:45 | |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Use _dump_results to filter the results https://review.openstack.org/483311 | 11:46 |
*** d0ugal has quit IRC | 11:47 | |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Fix dictionary change during iteration https://review.openstack.org/483232 | 11:50 |
*** yamamoto has joined #openstack-infra | 11:50 | |
*** yamamoto has quit IRC | 11:54 | |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Use package module to install bindep packages https://review.openstack.org/482584 | 11:58 |
*** florianf has joined #openstack-infra | 12:00 | |
*** dave-mccowan has joined #openstack-infra | 12:01 | |
*** thorst has quit IRC | 12:06 | |
*** Guest36023 has quit IRC | 12:09 | |
*** thorst has joined #openstack-infra | 12:11 | |
*** markvoelker has quit IRC | 12:13 | |
*** tuanluong has quit IRC | 12:16 | |
dims | DMCA takedown notice on Github - https://blog.freeyourgadget.org/our-dmca-takedown-a-post-mortem.html | 12:17 |
*** yamamoto has joined #openstack-infra | 12:17 | |
*** baoli has joined #openstack-infra | 12:23 | |
*** Guest36023 has joined #openstack-infra | 12:25 | |
*** baoli has quit IRC | 12:28 | |
*** baoli has joined #openstack-infra | 12:29 | |
*** trown|outtypewww is now known as trown | 12:30 | |
*** markvoelker has joined #openstack-infra | 12:32 | |
*** rwsu has joined #openstack-infra | 12:32 | |
*** cshastri has quit IRC | 12:34 | |
*** deep-book-gk_ has joined #openstack-infra | 12:34 | |
*** deep-book-gk_ has left #openstack-infra | 12:34 | |
*** gordc has joined #openstack-infra | 12:35 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/shade master: Updated from global requirements https://review.openstack.org/483327 | 12:36 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 12:36 |
*** slaweq_ has joined #openstack-infra | 12:38 | |
*** gcb has joined #openstack-infra | 12:39 | |
*** rwsu has quit IRC | 12:39 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 12:40 |
*** prateek has quit IRC | 12:41 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 12:41 |
*** slaweq_ has quit IRC | 12:43 | |
fungi | dims: the dmca counter notice the project filed is also a good read https://github.com/github/dmca/blob/master/2017/2017-06-20-MiBandTools-Counter-Notice.md | 12:43 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Use _dump_results to filter the results https://review.openstack.org/483311 | 12:44 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Emit errors from ansible more cleanly https://review.openstack.org/483335 | 12:44 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Strip zuul workdir from the play banner line https://review.openstack.org/483336 | 12:44 |
*** wolverineav has quit IRC | 12:45 | |
*** wolverineav has joined #openstack-infra | 12:45 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: Increase job timeout for openstack-ansible https://review.openstack.org/483338 | 12:45 |
*** wolverineav has quit IRC | 12:46 | |
*** wolverineav has joined #openstack-infra | 12:46 | |
*** wolverineav has quit IRC | 12:46 | |
*** alexchadin has joined #openstack-infra | 12:48 | |
dims | fungi : freaking screen shots and logs! | 12:49 |
*** wolverineav has joined #openstack-infra | 12:49 | |
fungi | yeah, your proprietary competition can have github take down your project if your users post logs and screenshots to your issue tracker apparently | 12:50 |
*** wolverineav has quit IRC | 12:50 | |
*** wolverineav has joined #openstack-infra | 12:50 | |
fungi | and they'll act on the complaint immediately but take weeks to act on the counter | 12:51 |
*** wolverineav has quit IRC | 12:51 | |
mordred | the counter takedown is the best | 12:54 |
mordred | I did my part by tweeting the counter-takedown and tagging @github | 12:55 |
*** d0ugal has joined #openstack-infra | 12:55 | |
*** kgiusti has joined #openstack-infra | 12:57 | |
*** links has quit IRC | 12:57 | |
*** wolverineav has joined #openstack-infra | 12:57 | |
*** Guest36023 has quit IRC | 12:58 | |
*** mattmceuen has quit IRC | 12:58 | |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add environment file for multinode tests on RDO Cloud https://review.openstack.org/481222 | 12:59 |
*** sbezverk has joined #openstack-infra | 13:02 | |
fungi | ttx: not sure if you saw, but i got the ptgbot installing and running pending review of the remaining patches under topic:ptgbot (including one minor dependency fix for the openstack/ptgbot repo) | 13:02 |
*** pgadiya has quit IRC | 13:02 | |
*** winggundamth has joined #openstack-infra | 13:02 | |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add support for zuul v3 RETRY_LIMIT to gerrit css https://review.openstack.org/483372 | 13:04 |
AJaeger | team, here's a bindep change that I'd like to see a review on, please - this will help RPM distros: https://review.openstack.org/#/c/476851/ | 13:05 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Use package module to install bindep packages https://review.openstack.org/482584 | 13:07 |
*** dhajare has quit IRC | 13:07 | |
*** d0ugal has quit IRC | 13:07 | |
*** pgadiya has joined #openstack-infra | 13:08 | |
*** alexchadin has quit IRC | 13:09 | |
*** mriedem has joined #openstack-infra | 13:09 | |
*** rhallisey has quit IRC | 13:11 | |
*** rhallisey has joined #openstack-infra | 13:12 | |
*** LindaWang has quit IRC | 13:13 | |
*** MatthewLi has quit IRC | 13:13 | |
*** LindaWang has joined #openstack-infra | 13:14 | |
*** MatthewLi has joined #openstack-infra | 13:14 | |
*** Guest36023 has joined #openstack-infra | 13:16 | |
*** d0ugal has joined #openstack-infra | 13:18 | |
*** d0ugal has quit IRC | 13:18 | |
*** d0ugal has joined #openstack-infra | 13:18 | |
*** dizquierdo has joined #openstack-infra | 13:18 | |
*** ihrachys has joined #openstack-infra | 13:19 | |
odyssey4me | project-config cores, we'd appreciate your prompt review of https://review.openstack.org/483338 - our master branch tests are largely failing due to the reasons mentioned in the commit msg | 13:19 |
*** d0ugal has quit IRC | 13:20 | |
*** d0ugal has joined #openstack-infra | 13:20 | |
pabelanger | +2 | 13:21 |
openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Install built repos on overcloud during overcloud upgrade https://review.openstack.org/483387 | 13:22 |
fungi | hwoarang: have a link to a log from one of the failures you're trying to troubleshoot? just want to see whether i have any simple suggestions before potentially going to the trouble of holding a node and adding remote access | 13:24 |
* fungi will brb | 13:24 | |
*** LindaWang has quit IRC | 13:25 | |
odyssey4me | thanks pabelanger | 13:25 |
ttx | fungi: ack will have a look | 13:25 |
*** eharney has joined #openstack-infra | 13:27 | |
tosky | I see a failure in a job which tries to download a Fedora cloud image from a Fedora mirror, but it bails out after failing on few IPv6 addresses | 13:27 |
openstackgerrit | Merged openstack-infra/bindep master: bindep: Query for RPM capabilities as well https://review.openstack.org/476851 | 13:27 |
tosky | namely here: http://logs.openstack.org/51/483251/2/check/gate-sahara-image-elements-buildimages-plain-ubuntu-xenial-nv/a7965cd/console.html | 13:27 |
tosky | could it be a problem with that specific Fedora mirror, or something related with IPv6 routing from (some?) nodes used by the jobs, or...? | 13:28 |
pabelanger | tosky: expected, fedoraproject.org is unrealible | 13:28 |
pabelanger | let me see if we mirror that into AFS today | 13:28 |
*** esberglu has joined #openstack-infra | 13:28 | |
pabelanger | tosky: the better way would be to switch to fedora-minimal element and build up our fedora images from RPMs | 13:28 |
*** bobh has joined #openstack-infra | 13:28 | |
*** d0ugal has quit IRC | 13:29 | |
tosky | pabelanger: not in that case, it's a image that it is used in the project, so I need the fedora cloud image | 13:29 |
*** mat128 has quit IRC | 13:30 | |
*** mat128 has joined #openstack-infra | 13:30 | |
tosky | oh, I see what you mean | 13:30 |
pabelanger | tosky: http://mirror.dfw.rax.openstack.org/fedora/releases/25/CloudImages/x86_64/images/ we do mirror them, so you can DIB to hit our AFS mirror, which are regional and local to jobs. See /etc/mirror.sh for more info from our images on how to resolve the proper URL | 13:30 |
tosky | but uhm | 13:31 |
tosky | pabelanger: interesting, thanks; /etc/mirror.sh where exactly? | 13:32 |
pabelanger | tosky: that will exist on our our images used in the gate | 13:33 |
*** mattmceuen has joined #openstack-infra | 13:33 | |
pabelanger | it gets created by: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/configure_mirror.sh | 13:33 |
*** thorst has quit IRC | 13:33 | |
pabelanger | jeblair: Shrews: interesting, we have a fedora-25 DIB in deleting state for 21 days | 13:34 |
pabelanger | | fedora-25-0000000357 | fedora-25 | nb04.openstack.org | qcow2,vhd | deleting | 21:19:41:30 | | 13:34 |
tosky | pabelanger: /tmp/mirror_info.sh ? | 13:34 |
pabelanger | going to see what happened there | 13:34 |
pabelanger | tosky: Oh, sorry, it is /etc/ci/mirror_info.sh | 13:35 |
pabelanger | tosky: line 104 | 13:35 |
*** tushar has quit IRC | 13:36 | |
*** tumbarka has joined #openstack-infra | 13:36 | |
tosky | oh | 13:36 |
openstackgerrit | Merged openstack-infra/project-config master: Increase job timeout for openstack-ansible https://review.openstack.org/483338 | 13:36 |
hwoarang | fungi: hello. yeah it's http://logs.openstack.org/38/482638/1/experimental/gate-openstack-ansible-galera_server-ansible-func-opensuse-422/8e2265d/console.html#_2017-07-13_08_30_48_364893 | 13:37 |
hwoarang | i need to see why restarting galera fails on opensuse. I can't reproduce it to a Vagrant environment so I want to see what's the deal on the CI hosts | 13:38 |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: WIP Testing changes required to move 3nodes job to quickstart https://review.openstack.org/483077 | 13:38 |
*** jascott1 has joined #openstack-infra | 13:38 | |
tosky | pabelanger: is that file automagically sourced in each bash session, or should I manually source it? | 13:38 |
pabelanger | tosky: you'll need to source it from your job | 13:38 |
tosky | pabelanger: ack, thanks | 13:39 |
pabelanger | np | 13:39 |
*** slaweq_ has joined #openstack-infra | 13:39 | |
tosky | pabelanger: I have another question related to dib and dib users - do you remember if the dib version should use constraints in stable branches of dib users? | 13:40 |
pabelanger | hwoarang: fungi: looks like job doesn't collect any logs from /var/logs when cleaning up. Might be a good time to add support for galera logs to help debug the issue | 13:40 |
*** trown is now known as trown|brb | 13:41 | |
*** jkilpatr has quit IRC | 13:42 | |
pabelanger | tosky: I seem to recall diskimage-builder betting added to contraints a while back, so it would make sense to use for stable branches. However, DIB is some what fast moving and we in openstack-infra only use the latest versions. You'd have to see what other projects do | 13:42 |
pabelanger | Wow, we have 550 centos-7-2-nodes going this morning | 13:43 |
*** jascott1 has quit IRC | 13:44 | |
*** slaweq_ has quit IRC | 13:44 | |
pabelanger | seems to be mostly from tripleo jobs | 13:45 |
*** trown|brb is now known as trown | 13:47 | |
*** jkilpatr has joined #openstack-infra | 13:47 | |
*** jcoufal has joined #openstack-infra | 13:52 | |
hwoarang | pabelanger: yeah although I think for this particular issue i may have to look at systemd stuff. but logging stuff to /var/log overall seems like a good idea... | 13:54 |
jlvillal | Hi infra. ironic-inspector gate is broken. This patch fixes it: https://review.openstack.org/483059 Reviews appreciated. | 13:54 |
*** amotoki is now known as amotoki_away | 13:54 | |
pabelanger | hwoarang: if you haven't already, look into devstack/devstack-gate, we recently made some changes to collect / compress systemd logs. You likely can do the same for ansible projects | 13:55 |
*** pgadiya has quit IRC | 13:56 | |
hwoarang | ok thank you | 13:56 |
*** sree has joined #openstack-infra | 13:59 | |
fungi | hwoarang: specifically, d-g now exports the raw journal filtered for devstack-initiated services, but the filtering is pretty flexible and can be adapted to whatever services you care about in your jobs | 14:01 |
hwoarang | hmm ok i will have a look | 14:02 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Parameterize puppet version in install script https://review.openstack.org/481955 | 14:03 |
cmurphy | calebb: ^ | 14:03 |
*** hongbin has joined #openstack-infra | 14:06 | |
fungi | hwoarang: have a link to an ssh public key i can authorize on a held ci node? | 14:06 |
*** Goneri has joined #openstack-infra | 14:07 | |
*** LindaWang has joined #openstack-infra | 14:07 | |
hwoarang | fungi: http://dev.gentoo.org/~hwoarang/id_rsa_gentoo.pub | 14:08 |
hwoarang | fungi: can you allocate an ipv4 node? i don't have ipv6 at all :( | 14:08 |
fungi | hwoarang: yep, i anticipated that and waited around for one with a v4 address to come up | 14:09 |
hwoarang | ah awesome thanks! | 14:09 |
openstackgerrit | Lucas Alvares Gomes proposed openstack-infra/project-config master: Add ovsdbapp to PROJECTS https://review.openstack.org/483406 | 14:10 |
fungi | hwoarang: try to `ssh jenkins@46.254.11.239` and see if you can get to the shell. that user should still have full sudo privs allowed on the instance | 14:11 |
hwoarang | fungi: works fine thanks! | 14:12 |
fungi | hwoarang: great. let me know once you're done with it so i can release it back into the pool | 14:12 |
openstackgerrit | Lucas Alvares Gomes proposed openstack-infra/project-config master: Add ovsdbapp to PROJECTS https://review.openstack.org/483406 | 14:12 |
hwoarang | fungi: yeah i will do . thank you very much | 14:12 |
*** rossella_ has quit IRC | 14:13 | |
fungi | my pleasure | 14:14 |
*** sergK_ has quit IRC | 14:14 | |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Emit errors from ansible more cleanly https://review.openstack.org/483335 | 14:15 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Strip zuul work dir from the play banner line https://review.openstack.org/483336 | 14:15 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Filter and print results more comprehensively https://review.openstack.org/483311 | 14:15 |
*** e0ne_ has quit IRC | 14:16 | |
*** dhajare has joined #openstack-infra | 14:19 | |
*** dhajare has quit IRC | 14:20 | |
Shrews | pabelanger: re: the 'deleting' dib, i noticed while you were on vacation that we had some zk entries recorded with builder hostname that had changed (one was fully qualified, one was not). | 14:20 |
*** aarefiev is now known as aarefiev_afk | 14:21 | |
Shrews | pabelanger: i forget the details of that, but one thing i want to do is change nodepool to use a UUID for that instead (or in addition to) hostname | 14:21 |
pabelanger | Shrews: ya, I thought we landed a fix a while back too. Will look into open reviews and see if we restarted nodepool-builders since then | 14:22 |
Shrews | pabelanger: don't ask me how the hostname changed | 14:22 |
pabelanger | Shrews: ya, I think it was a result of a reboot | 14:22 |
pabelanger | but not sure why that is | 14:22 |
pabelanger | Shrews: ya, looks like you are right. hostname is nb04.o.o for the stuck DIB | 14:22 |
*** psachin has quit IRC | 14:22 | |
Shrews | pabelanger: i don't recall any fixes related to that. the uuid thing _would_ be the fix | 14:22 |
fungi | dhcp lease asserting an empty domain name in /etc/resolv.conf maybe? | 14:23 |
pabelanger | Shrews: ack | 14:23 |
Shrews | pabelanger: a quick fix for that might be to manually change the recorded hostname in zk, unless jeblair has another idea | 14:24 |
*** e0ne has joined #openstack-infra | 14:24 | |
fungi | du says our apache proxy caches are up around 14-28g in our various providers, so looks like we're as high as ~40% of what i budgeted for them so far | 14:26 |
*** rbrndt has joined #openstack-infra | 14:27 | |
fungi | just realized i should restart snmpd on the ones that got cinder volumes | 14:28 |
fungi | so we can start tracking them in cacti | 14:28 |
*** rossella_ has joined #openstack-infra | 14:29 | |
*** thorst has joined #openstack-infra | 14:29 | |
*** LindaWang has quit IRC | 14:31 | |
*** LindaWang has joined #openstack-infra | 14:31 | |
*** sergK_ has joined #openstack-infra | 14:32 | |
openstackgerrit | James Page proposed openstack-infra/project-config master: charms: Add deployment guide https://review.openstack.org/483429 | 14:32 |
*** cshen has quit IRC | 14:32 | |
*** cshen has joined #openstack-infra | 14:35 | |
*** vhosakot has joined #openstack-infra | 14:36 | |
*** marst has quit IRC | 14:37 | |
*** gouthamr has joined #openstack-infra | 14:37 | |
*** ldnunes has quit IRC | 14:39 | |
*** slaweq_ has joined #openstack-infra | 14:40 | |
*** wolverineav has quit IRC | 14:42 | |
*** slaweq_ has quit IRC | 14:45 | |
*** wolverineav has joined #openstack-infra | 14:45 | |
*** marst has joined #openstack-infra | 14:47 | |
hwoarang | fungi: the timing is horrible. opensuse mirrors are having some issues right now so i can't do much. perhaps I should release the node and reserve one when everything is back online :/ | 14:51 |
*** wolverineav has quit IRC | 14:51 | |
*** ldnunes has joined #openstack-infra | 14:51 | |
*** Julien-zte has quit IRC | 14:53 | |
*** wolverineav has joined #openstack-infra | 14:53 | |
calebb | cmurphy: lgtm | 14:53 |
*** makowals_ has joined #openstack-infra | 14:53 | |
*** felipemonteiro has joined #openstack-infra | 14:53 | |
*** jtomasek_ is now known as jtomasek | 14:53 | |
*** Julien-zte has joined #openstack-infra | 14:54 | |
*** iyamahat has joined #openstack-infra | 14:54 | |
*** Guest36023 has quit IRC | 14:54 | |
*** felipemonteiro_ has joined #openstack-infra | 14:55 | |
*** andreas_s has quit IRC | 14:55 | |
*** wolverin_ has joined #openstack-infra | 14:55 | |
*** vhosakot has quit IRC | 14:55 | |
*** makowals has quit IRC | 14:56 | |
*** vhosakot has joined #openstack-infra | 14:56 | |
fungi | hwoarang: any idea how long they're going to be broken? | 14:56 |
jeblair | Shrews, pabelanger: how about: nodepool delete fedora-25-0000000357 --now | 14:56 |
*** wolverin_ has quit IRC | 14:57 | |
*** wolverin_ has joined #openstack-infra | 14:57 | |
*** wolverineav has quit IRC | 14:58 | |
*** felipemonteiro has quit IRC | 14:59 | |
*** Swami has joined #openstack-infra | 15:01 | |
*** raissa_ is now known as raissa | 15:01 | |
Shrews | jeblair: that deletes instances, iirc. dib-image-delete is the thing, but that only sets the state to DELETING | 15:01 |
*** raissa has quit IRC | 15:01 | |
*** bobh has quit IRC | 15:01 | |
*** Guest78018 has joined #openstack-infra | 15:01 | |
*** e0ne has quit IRC | 15:01 | |
hwoarang | fungi: no clue. i opened a ticket but i don't think anything will happen today | 15:01 |
*** vhosakot_ has joined #openstack-infra | 15:03 | |
jeblair | Shrews: derp that's an image | 15:03 |
jeblair | Shrews, pabelanger: yeah, i don't have a better suggestion. | 15:03 |
*** Guest78018 is now known as raissa_ | 15:04 | |
fungi | hwoarang: no worries. maybe you can take the opportunity to patch osad to collect galera logs? i'll go ahead and delete the held suse node for now | 15:05 |
*** vhosakot has quit IRC | 15:05 | |
hwoarang | yeah i will have a look at it. i am logging out from the node | 15:05 |
*** isaacb_ has quit IRC | 15:06 | |
*** vhosakot_ has quit IRC | 15:06 | |
*** vhosakot has joined #openstack-infra | 15:06 | |
*** e0ne has joined #openstack-infra | 15:09 | |
*** Guest36023 has joined #openstack-infra | 15:11 | |
*** armax has joined #openstack-infra | 15:11 | |
*** dizquierdo has quit IRC | 15:11 | |
*** dizquierdo has joined #openstack-infra | 15:12 | |
fungi | hwoarang: thanks for the heads up, i've marked that one for deletion now | 15:12 |
hwoarang | thank you | 15:16 |
*** cody-somerville has joined #openstack-infra | 15:19 | |
*** cody-somerville has quit IRC | 15:19 | |
*** cody-somerville has joined #openstack-infra | 15:19 | |
fungi | any time! | 15:19 |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: WIP Testing changes required to move 3nodes job to quickstart https://review.openstack.org/483077 | 15:19 |
gouthamr | hey infra-cores, looking for a +2/+W on https://review.openstack.org/#/c/482785/ | 15:20 |
bswartz | AJaeger yolanda: did you intend to +w this but forgot? https://review.openstack.org/#/c/482785/ | 15:20 |
*** wolverin_ has quit IRC | 15:20 | |
*** wolverineav has joined #openstack-infra | 15:21 | |
*** jkilpatr has quit IRC | 15:23 | |
*** ykarel_ has quit IRC | 15:23 | |
*** gcb has quit IRC | 15:23 | |
*** ykarel has quit IRC | 15:23 | |
*** ccamacho has quit IRC | 15:25 | |
*** rcernin has quit IRC | 15:27 | |
*** wolverineav has quit IRC | 15:28 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: zypper: Enable explicit sudo logging https://review.openstack.org/483446 | 15:31 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: zypper: Enable explicit sudo logging https://review.openstack.org/483446 | 15:33 |
*** winggundamth has quit IRC | 15:33 | |
*** pcaruana has quit IRC | 15:38 | |
pabelanger | fungi: clarkb: jeblair: mordred: So, I've noticed a new trend since returning this week, we seem to have more an more jobs pushing 3+ hours in our pipelines. Specifically they seem to be mostly tripleo and tempest jobs. I think with tripleo increasing cross project jobs for other projects and decrease in infracloud / bluebox / osic-cloud1 it contirbuting job delays we have been seeing this week. I | 15:38 |
pabelanger | wonder if we should maybe have a topic at PTG about job runtimes and working with projects to start bringing them back down to 90mins levels? | 15:38 |
pabelanger | I know some other projects are also expanding there jobs too (not only focusing on tripleo) | 15:39 |
*** kjackal_ has joined #openstack-infra | 15:39 | |
pabelanger | kolla for example | 15:39 |
*** slaweq_ has joined #openstack-infra | 15:41 | |
*** bobh has joined #openstack-infra | 15:44 | |
fungi | yeah, we talked with amrith at the last ptg about ways to bring down job runtimes, for example by splitting into separate jobs and maybe future options for staging job dependencies in zuul v3 if we can work out a way to pass built artifacts from one job to subsequent jobs in check/gate | 15:44 |
fungi | maybe having a similar conversation with other project devs could help | 15:44 |
*** thorst has quit IRC | 15:45 | |
pabelanger | fungi: ya, I think dag jobs for tripleo will be most helpful, they spend a lot of time building artifacts for there jobs | 15:45 |
xgerman_ | o/ | 15:45 |
*** bhavik1 has joined #openstack-infra | 15:45 | |
*** thorst has joined #openstack-infra | 15:46 | |
tosky | that something I wanted to ask too: we would like to add some "heavier" jobs in Sahara (which tests with the non-fake plugin) | 15:46 |
fungi | the shift to doing more things during job runtime, while increasing flexibility for the jobs themselves, means we have a lot of similar jobs for a given change doing nearly identical pre-test build of needed artifacts | 15:46 |
*** slaweq_ has quit IRC | 15:46 | |
tosky | so the question is: how is the limit of resources (time, nodes) that we can (ab)use from infra per each job? | 15:46 |
tosky | (I can send an email to -infra list in case) | 15:47 |
xgerman_ | I am from the Octavia team and we were thinking about adding a weekly/daily job to build some artefact and push somewhere on the Internet. Wonder if we can set up a job like that or if that would not work? | 15:47 |
*** ihrachys has quit IRC | 15:48 | |
fungi | xgerman_: we already have projects doing that (mostly small, purpose-built server/container images) updated on tarballs.openstack.org | 15:48 |
xgerman_ | cool! You have an example? | 15:48 |
pabelanger | fungi: ++ | 15:48 |
*** ihrachys has joined #openstack-infra | 15:48 | |
fungi | xgerman_: just yesterday we also completed an effort to expose a caching proxy for tarballs.openstack.org on our local mirror servers in each of our ci provider networks | 15:48 |
xgerman_ | neat!! | 15:49 |
fungi | xgerman_: the ironic python agent images are probably a good example... i'll see if i can find you an example once tc office hour is done | 15:49 |
xgerman_ | ok, great. Thanks a dozen! | 15:49 |
tosky | xgerman_: if you check sahara jobs, we publish few artifacts as well | 15:50 |
*** thorst has quit IRC | 15:50 | |
xgerman_ | awesome. I will have a look!! | 15:50 |
*** Julien-zte has quit IRC | 15:50 | |
*** mat128 has quit IRC | 15:50 | |
tosky | the jobs for sahara-extra namely; they are all in jenkins/jobs/sahara.yaml in project-config | 15:51 |
*** ihrachys has quit IRC | 15:51 | |
*** Julien-zte has joined #openstack-infra | 15:51 | |
xgerman_ | thanks | 15:51 |
fungi | tosky: the best answers we have there are keeping the number of jobs you run on a change to a reasonable number, working to make your jobs as quick as possible (e.g. making them not do unnecessary extra work which isn't required for your job, maybe also lowering your job timeouts), and generally being cautious to not recheck changes without first investigating whether job failures are actually caused | 15:52 |
fungi | by the change | 15:52 |
tosky | fungi: fine :) but that's the easy part; the complicated part is the definition of "reasonable" | 15:52 |
fungi | tosky: also helping the qa team with elastic-recheck categorization and pitching in solving some of the more frequent nondeterministic failures helps everyone across the board consume a lower volume of ci resources | 15:52 |
AJaeger | bswartz: yolanda wanted to wait for manila team to review - we really like to have project teams to review before we approve. | 15:53 |
AJaeger | bswartz: I can +W now | 15:53 |
bswartz | AJaeger: ty | 15:53 |
tosky | maybe we could also enhance the split between check and gate jobs, which we are not doing too well | 15:53 |
tosky | so few heavier gate jobs not run normally, but maybe connected to experimental | 15:54 |
fungi | tosky: one of the ways "reasonable" has been defined in the past is looking at individual tests or perhaps even whole jobs and possibly getting rid of them entirely if they never catch any actual mistakes in changes | 15:54 |
*** ihrachys has joined #openstack-infra | 15:54 | |
*** e0ne has quit IRC | 15:55 | |
fungi | tosky: for example, if i'm remembering correctly, the tempest team has used the subunit2sql database (which is what the health dashboard is built on top of as well) to find tempest tests which never actually fail | 15:55 |
tosky | I agree, but few cases I had in mind are the scenario tests for different plugins in sahara; or at least 2 or 3 of them | 15:56 |
tosky | they are definitely different code paths | 15:56 |
tosky | but they are going to take a while | 15:56 |
tosky | one hour each, and some of them probably multinode | 15:57 |
fungi | tosky: also, if you can get in the habit of tracking your periodic job results on http://status.openstack.org/openstack-health/#/g/project/openstack~2Fsahara or whatever you can consider moving some of your longer-running jobs into the periodic pipeline and just have them run daily to try and spot less likely regressions rather than on every proposed change. it can be a useful middle ground | 15:57 |
tosky | uhm | 15:58 |
*** Apoorva has joined #openstack-infra | 15:58 | |
openstackgerrit | Merged openstack-infra/project-config master: Limit jobs in manila driverfixes branches https://review.openstack.org/482785 | 15:59 |
tosky | I guess I have to draft the jobs, try to introduce them first as experimental, evaluate them, and then decide whether to move to gate, periodic, both, or a combination | 15:59 |
tosky | thanks for the hints | 15:59 |
fungi | tosky: sure. there's no one right answer, just a lot of options. we try to be flexible | 16:00 |
tosky | on the other side, I totally understand the problems coming from constrained resources | 16:00 |
openstackgerrit | Merged openstack/ptgbot master: List requests as a requirement https://review.openstack.org/483120 | 16:01 |
*** dtantsur is now known as dtantsur|afk | 16:02 | |
fungi | tosky: a useful trick is to have experimental pipeline versions of your periodic jobs, so you can test potential fixes on demand for regressions only spotted by your periodic jobs | 16:02 |
*** camunoz has joined #openstack-infra | 16:03 | |
*** LindaWang has quit IRC | 16:04 | |
*** LindaWang has joined #openstack-infra | 16:04 | |
*** LindaWang has quit IRC | 16:06 | |
EmilienM | pabelanger: I was wondering if you could help us on https://bugs.launchpad.net/tripleo/+bug/1704145 - I'm wondering how we can stop mixing tripleo & puppet jobs in the gate | 16:08 |
openstack | Launchpad bug 1704145 in tripleo "ocata upgrade job broken trying to build puppet-vitrage package" [High,Triaged] | 16:08 |
EmilienM | pabelanger: we have seen quite often that tripleo checkouts repos that are in the same batch of jobs in the gate but sometimes it's wrong, it shoulnd't do that, since tripleo doesn't use these repos at all | 16:09 |
*** gyee has joined #openstack-infra | 16:09 | |
*** jpich has quit IRC | 16:09 | |
*** jtomasek has quit IRC | 16:10 | |
fungi | EmilienM: the way you prevent them from sharing a dependent queue is by making sure they share no jobs in common (by renaming jobs they do both run, if necessary) | 16:10 |
fungi | EmilienM: i'm not sure how your jobs decide which additional repos to checkout, but if they're looking at the zuul envvars to get a list of repos or something like that, then avoiding sharing a job queue may be the answer | 16:12 |
pabelanger | EmilienM: agree with fungi | 16:14 |
EmilienM | fungi: ok I see | 16:15 |
fungi | EmilienM: most of our job frameworks (e.g. devstack-gate) take static lists of repositories to checkout. varying that based on what other changes are being tested, if that's what tripleo is actually doing, can quickly lead to deadlocks because you're not following a consistent test methodology between one run and the next | 16:16 |
*** bhavik1 has quit IRC | 16:18 | |
*** tesseract has quit IRC | 16:19 | |
*** jamielennox has quit IRC | 16:19 | |
*** slaweq has quit IRC | 16:20 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Add html based websocket client for console stream https://review.openstack.org/481599 | 16:20 |
*** dprince has quit IRC | 16:21 | |
*** lucasagomes is now known as lucas-afk | 16:22 | |
EmilienM | fungi: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/tripleo.yaml#L138-L179 | 16:23 |
EmilienM | I think we override it | 16:23 |
*** eharney has quit IRC | 16:23 | |
*** kjackal_ has quit IRC | 16:25 | |
*** eharney has joined #openstack-infra | 16:26 | |
*** vhosakot_ has joined #openstack-infra | 16:28 | |
*** dizquierdo has quit IRC | 16:28 | |
*** chlong has joined #openstack-infra | 16:30 | |
*** chlong has quit IRC | 16:32 | |
*** dizquierdo has joined #openstack-infra | 16:32 | |
*** vhosakot has quit IRC | 16:32 | |
*** chlong has joined #openstack-infra | 16:33 | |
*** csomerville has joined #openstack-infra | 16:34 | |
*** cody-somerville has quit IRC | 16:38 | |
*** gouthamr has quit IRC | 16:41 | |
*** zzzeek_ has quit IRC | 16:41 | |
*** dizquierdo has quit IRC | 16:41 | |
*** gouthamr has joined #openstack-infra | 16:42 | |
*** slaweq has joined #openstack-infra | 16:42 | |
*** iyamahat has quit IRC | 16:43 | |
*** zzzeek has joined #openstack-infra | 16:43 | |
*** jaosorior has joined #openstack-infra | 16:46 | |
*** thorst has joined #openstack-infra | 16:46 | |
*** slaweq has quit IRC | 16:47 | |
*** dprince has joined #openstack-infra | 16:49 | |
*** rwsu has joined #openstack-infra | 16:49 | |
*** sree has quit IRC | 16:50 | |
*** egonzalez has quit IRC | 16:50 | |
*** sree has joined #openstack-infra | 16:51 | |
*** felipemonteiro_ has quit IRC | 16:51 | |
*** rossella__ has joined #openstack-infra | 16:54 | |
*** sree has quit IRC | 16:55 | |
*** Apoorva_ has joined #openstack-infra | 16:56 | |
*** inc0 has quit IRC | 16:56 | |
*** inc0 has joined #openstack-infra | 16:57 | |
*** mhickey has quit IRC | 16:57 | |
*** rossella_ has quit IRC | 16:57 | |
*** shardy has quit IRC | 16:58 | |
*** ralonsoh has quit IRC | 16:59 | |
*** Apoorva has quit IRC | 17:00 | |
*** iyamahat has joined #openstack-infra | 17:02 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Add html based websocket client for console stream https://review.openstack.org/481599 | 17:04 |
*** yamahata has joined #openstack-infra | 17:09 | |
*** e0ne has joined #openstack-infra | 17:09 | |
*** xarses has joined #openstack-infra | 17:12 | |
*** rossella__ has quit IRC | 17:13 | |
*** sambetts is now known as sambetts|afk | 17:14 | |
*** jerryz has joined #openstack-infra | 17:16 | |
*** jkilpatr has joined #openstack-infra | 17:18 | |
*** electrofelix has quit IRC | 17:23 | |
*** liusheng has quit IRC | 17:25 | |
*** jkilpatr has quit IRC | 17:26 | |
*** liusheng has joined #openstack-infra | 17:26 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Add html based websocket client for console stream https://review.openstack.org/481599 | 17:26 |
*** harlowja has quit IRC | 17:27 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Add html based websocket client for console stream https://review.openstack.org/481599 | 17:27 |
*** tosky has quit IRC | 17:34 | |
*** SumitNaiksatam has joined #openstack-infra | 17:35 | |
*** slaweq has joined #openstack-infra | 17:35 | |
*** slaweq has quit IRC | 17:35 | |
*** slaweq has joined #openstack-infra | 17:36 | |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Document start day of week https://review.openstack.org/483279 | 17:36 |
*** rwsu has quit IRC | 17:38 | |
*** rbrndt has quit IRC | 17:38 | |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Fix status_url section in zuul.conf-sample https://review.openstack.org/483166 | 17:39 |
*** rwsu has joined #openstack-infra | 17:39 | |
*** mat128 has joined #openstack-infra | 17:42 | |
*** mat128 has quit IRC | 17:43 | |
*** slaweq_ has joined #openstack-infra | 17:43 | |
openstackgerrit | Serguei Bezverkhi proposed openstack-infra/project-config master: Adding to kolla-kubernetes jobs to test master https://review.openstack.org/483479 | 17:43 |
*** trown is now known as trown|lunch | 17:44 | |
openstackgerrit | Ben Kero proposed openstack-infra/nodepool master: Correctly source JenkinsException https://review.openstack.org/483480 | 17:44 |
*** slaweq_ has quit IRC | 17:48 | |
dhellmann | fungi : would this be a good time to rearrange some doc content on the web server? | 17:49 |
fungi | dhellmann: yep! security team meeting just wrapped up and i've about finished scarfing down my lunch | 17:50 |
dhellmann | fungi : I can wait for you to finish your lunch :-) | 17:50 |
fungi | jeblair: did you have some idea as to the safest way to go about preventing a vos release of the docs volume while we're rearranging? | 17:50 |
jeblair | fungi: disable cron job? | 17:51 |
odyssey4me | I need a little time to discuss a cross-project test job implementation with any of the project-config experts: https://review.openstack.org/482474 | 17:51 |
jeblair | fungi: i thought it was a cronjob... | 17:52 |
odyssey4me | anyone available to give it a look through to validate whether it'll work as-is or if there's another way to achieve it? | 17:52 |
*** pradk has quit IRC | 17:53 | |
openstackgerrit | Ben Kero proposed openstack-infra/nodepool master: Add SSH Host Key Verifier Strategy https://review.openstack.org/483485 | 17:54 |
jeblair | fungi: oh it's on afsdb01 | 17:54 |
bkero | I'm posting nodepool patches. Sorry. | 17:54 |
*** krtaylor has quit IRC | 17:55 | |
fungi | jeblair: oh, right. that's simple. for some reason i forgot it wasn't a separate ci job doing the vos release | 17:55 |
*** rossella__ has joined #openstack-infra | 17:55 | |
fungi | i'll temporarily disable it there and #status log before and after | 17:55 |
inc0 | hey guys, dockerhub publisher again, how do I go to develop it? | 17:56 |
jeblair | fungi: probably stick afsdb01 in emergency too to keep puppet from readding it | 17:56 |
inc0 | way we want it to work is to download from tarballs, unpack, publish | 17:56 |
fungi | jeblair: yep, that's the plan. thanks! | 17:56 |
inc0 | how can I develop it without access to secrets? | 17:57 |
pabelanger | inc0: right, we'd create a post job to do this, and download to a trusted server with credientials | 17:57 |
inc0 | but trusted server will have to do some job | 17:57 |
pabelanger | then, either push to a docker directly or our own registry, and mirror | 17:57 |
inc0 | which I'm wondering how to develop | 17:58 |
pabelanger | well, we still have a spec up for it | 17:58 |
pabelanger | needs to be voted on still | 17:58 |
pabelanger | but, I have most of the work already done | 17:58 |
inc0 | well, there is more to that | 17:59 |
*** verdurin has quit IRC | 17:59 | |
inc0 | we need to include build job info | 17:59 |
*** Swami has quit IRC | 17:59 | |
pabelanger | right, that is a release problem that needs to be solved too, but the publisher will be independant of that | 17:59 |
inc0 | I mean I'm fine with writing the code myself, just let me know where to put it temporarily | 17:59 |
inc0 | what release proble,? | 18:00 |
pabelanger | well, I think we'd want release team involved likely | 18:00 |
*** pradk has joined #openstack-infra | 18:00 | |
pabelanger | since they likely want to deal with proper versioning of things | 18:00 |
inc0 | no, it's different, it's nightly job | 18:00 |
inc0 | it *can't* go through regular release | 18:00 |
inc0 | for security reasons | 18:00 |
inc0 | we had TC discuss and voted on it | 18:01 |
openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Test changes of pymod2pkg and renderspec against rpm-packaging https://review.openstack.org/483491 | 18:01 |
pabelanger | inc0: do you have a link to the discussion? | 18:01 |
inc0 | https://github.com/openstack/governance/blob/master/resolutions/20170530-binary-artifacts.rst | 18:02 |
fungi | there is a tc resolution | 18:02 |
fungi | yeah, that one | 18:02 |
*** jascott1 has joined #openstack-infra | 18:02 | |
inc0 | there is lenghty mail thread linked there | 18:03 |
pabelanger | For these reasons, binary artifacts published to third-party registries should only be built from well-defined points in the history of an OpenStack project, identified with signed tags on the git repository. | 18:03 |
inc0 | in any case, because we need to keep all the packages in containers up to date, we can't build them every few months | 18:03 |
*** felipemonteiro has joined #openstack-infra | 18:03 | |
pabelanger | that to means, tagged releases | 18:03 |
*** mat128 has joined #openstack-infra | 18:03 | |
*** eharney has quit IRC | 18:03 | |
inc0 | but *not* images themselves | 18:03 |
*** felipemonteiro_ has joined #openstack-infra | 18:04 | |
fungi | the tl;dr is that since we'd be redistributing software which isn't under our direct control (an entire linux distro in effect) we can't make security guarantees about the bits we don't maintain, so publishing development snapshots instead of things branded as release images is one means of avoiding people thinking there's more support for these than there is | 18:04 |
inc0 | because I can put specific version of nova into container but I can't freeze all deps and other packages in time because if CVE is introduced, update needs to be ther | 18:04 |
inc0 | that too | 18:04 |
*** mat128 has quit IRC | 18:05 | |
pabelanger | right, so if snapshot, what version information do you need? | 18:05 |
*** slaweq has quit IRC | 18:06 | |
pabelanger | wouldn't it just be something like snapshot-stable-pike.docker-foo? | 18:06 |
pabelanger | that gets rebuild each day | 18:06 |
*** Apoorva_ has quit IRC | 18:06 | |
pabelanger | Or has there been a versioning schema decided already? | 18:06 |
fungi | presumably copies of these: http://tarballs.openstack.org/kolla/images/ | 18:07 |
inc0 | no, at some point we'll have list of versions of every package in container available | 18:07 |
*** Apoorva has joined #openstack-infra | 18:07 | |
inc0 | yes, versioned schema (at least first one) is decided already. | 18:07 |
pabelanger | fungi: right, the job would create the image name, and we just use that in trusted job to publish | 18:07 |
inc0 | we start with daily top of the branch for :ocata and :master which will be :pike at some point | 18:07 |
*** felipemonteiro has quit IRC | 18:08 | |
*** dmsimard is now known as dmsimard|afk | 18:08 | |
inc0 | I need to meddle with tarball before publishing, I can write script that will take tarball and output images ready to publish (or even publish it) | 18:08 |
*** jcoufal has quit IRC | 18:09 | |
pabelanger | basically, heres how I have been doing docker image builds between machines http://git.openstack.org/cgit/openstack/dox/tree/tools/tarball.sh | 18:09 |
fungi | so each of those tarballs is a bundle of images which will be published separately to the hub? | 18:09 |
inc0 | but thing is what it will do it will start a tarball-registry, docker pull all images, docker tag all the images to new registry, add metadata about jobs it passed and docker push all the images | 18:09 |
inc0 | with docker login before that | 18:09 |
inc0 | yes | 18:09 |
inc0 | tarball is registry with images, not images themselves | 18:10 |
*** efoley has quit IRC | 18:10 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Run playbooks with only those roles defined thus far https://review.openstack.org/483141 | 18:10 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add child roles before parent https://review.openstack.org/483142 | 18:10 |
pabelanger | Ya, we want to change that I think. We just need images, not the full registry | 18:10 |
inc0 | no we *do not* want to change that | 18:10 |
inc0 | this is smallest thing we could get | 18:10 |
inc0 | this is much smaller than docker save and easier to handle by our gates | 18:11 |
inc0 | we might want to chagne that if and only if we find better and more efficient way to store these images | 18:11 |
inc0 | but I don't know of any | 18:11 |
fungi | #status log puppet updates for afsdb01 have been temporarily suspended and its vos release cronjob disabled in preparation for manually reorganizing the docs volume | 18:11 |
openstackstatus | fungi: finished logging | 18:11 |
fungi | jeblair: dhellmann: ^ | 18:11 |
dhellmann | fungi : ack | 18:12 |
*** Guest36023 has quit IRC | 18:12 | |
pabelanger | I disagree, everything I have read about docker is docker save \ docker export is the way to share images. not gzipping up the contents of the registry itself. Also, I still don't understand why the would be a difference in sizes between the two | 18:12 |
inc0 | pabelanger: just try it | 18:13 |
pabelanger | inc0: I have | 18:13 |
pabelanger | both are the same in my testing | 18:13 |
inc0 | did you try it on 200 images we have? | 18:13 |
jerryz | fungi: could you please add me in fuel-plugin-fortinet-core and fuel-plugin-fortinet-release group? thanks! | 18:13 |
pabelanger | I haven't done it again kolla, but can | 18:13 |
inc0 | try it with whole set of kolla images please | 18:14 |
inc0 | also reason it's easier to handle for us is because we setup registry in multinode gates | 18:14 |
inc0 | and use docker pull, that's much more convenient | 18:14 |
pabelanger | Right, you can do the same but docker import http://tarballs.o.o/foo.tar.gz and get the same result | 18:15 |
inc0 | I would need to do docker import on all the child nodes too | 18:16 |
*** slaweq has joined #openstack-infra | 18:16 | |
inc0 | whcih means I would need to download whole set of images in all the nodes | 18:16 |
pabelanger | no, just on your registry node | 18:16 |
*** jkilpatr has joined #openstack-infra | 18:16 | |
inc0 | as opposed to just one node,start registry, pull only images you need | 18:16 |
pabelanger | everything else would still use your local registry | 18:16 |
*** e0ne has quit IRC | 18:16 | |
inc0 | then I need to pull, import, retag, push | 18:16 |
inc0 | quite a bit time consuming and io intensive | 18:17 |
*** slaweq has quit IRC | 18:17 | |
inc0 | also if you're so convinced that this is much better, I'll happily review these changes | 18:18 |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Use port-security version of OVB templates https://review.openstack.org/460748 | 18:19 |
pabelanger | Yes, once we have publisher pipeline in place, I am happy to demo the process with openstack/dox, it has a few images | 18:19 |
inc0 | cool, let's first have publisher please | 18:19 |
inc0 | also it becomes significant at scale of kolla images | 18:19 |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add settings for ovb in rdocloud https://review.openstack.org/480950 | 18:20 |
inc0 | again, we have north of 200 of them | 18:20 |
inc0 | that's why it's critical for us to handle them effectively | 18:20 |
pabelanger | agree | 18:20 |
fungi | dhellmann: i've worked out write access to the volume and am now using 481710 to generate the script | 18:22 |
inc0 | so back to original question | 18:22 |
dhellmann | fungi : sounds good | 18:22 |
inc0 | I'll need to have this logic | 18:22 |
inc0 | I'm happyu to write it | 18:22 |
inc0 | just tell me how to go about it | 18:22 |
inc0 | if I create fake dockerhub account and hardcode creds in ENV | 18:22 |
inc0 | put it into experimental job and work from there | 18:23 |
inc0 | can you use this later? | 18:23 |
fungi | assuming the idea is to then switch the job to the periodic pipeline, and run it on a trusted node where we install the credentials for the real account | 18:23 |
inc0 | or you just need shell script handle-my-images.sh user=foo password=bar | 18:23 |
pabelanger | https://review.openstack.org/#/c/401003/ | 18:24 |
*** Guest36023 has joined #openstack-infra | 18:24 | |
inc0 | fungi: I'd hope this is the idea | 18:24 |
pabelanger | that would create a docker registry we'd use | 18:24 |
inc0 | can we run trusted nodes in periodic? | 18:24 |
pabelanger | we'd likely have zlstatic01.o.o connect to it | 18:24 |
inc0 | but we wanted dockerhub... | 18:24 |
inc0 | I'd start with dockerhub tbh | 18:25 |
inc0 | we can add multiple places afterwards | 18:25 |
pabelanger | yes, we need a server running docker first | 18:25 |
pabelanger | that would be the server | 18:25 |
inc0 | dockerhub... | 18:25 |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: WIP: Add settings for ovb in rdocloud https://review.openstack.org/480950 | 18:25 |
inc0 | https://hub.docker.com | 18:25 |
inc0 | this thing | 18:25 |
*** mat128 has joined #openstack-infra | 18:25 | |
inc0 | and/or quay.io | 18:25 |
pabelanger | inc0: yes, trusted nodes are static nodes on our control plane | 18:25 |
pabelanger | note managed by nodepool | 18:26 |
pabelanger | not* | 18:26 |
pabelanger | so, we need to bring it online via system-config | 18:26 |
inc0 | ah, this won't serve docker registry, it will run job | 18:26 |
inc0 | sorry, my bad | 18:26 |
*** verdurin has joined #openstack-infra | 18:26 | |
pabelanger | right, if we had the registry running on that server, we could then mirror to other registry, over pushing directly | 18:27 |
fungi | dhellmann: okay, the script generation is complete and i'm copying it to the system where it will be run | 18:27 |
pabelanger | I think that is better for us actually, so we avoid network issues at job run time | 18:27 |
dhellmann | fungi : ++ | 18:27 |
dhellmann | fungi : do you want me to review the output? | 18:27 |
dhellmann | I don't have to, but will if a 2nd set of eyes makes you feel more comfortable | 18:28 |
fungi | dhellmann: sure, just a sec and i'll put it somewhere temporary that isn't paste.o.o (so it doesn't get truncated) | 18:28 |
dhellmann | fungi : ack | 18:28 |
inc0 | so, what's missing from mnaser 's change? | 18:28 |
inc0 | https://review.openstack.org/#/c/401003/12 that is | 18:28 |
inc0 | ah, looking at commit message it is docker registry... | 18:29 |
openstackgerrit | Serguei Bezverkhi proposed openstack-infra/project-config master: Adding to kolla-kubernetes jobs to test master https://review.openstack.org/483479 | 18:29 |
pabelanger | we'll need to some work for AFS, make sure k5start works properly for docker-registry, and test | 18:29 |
inc0 | so, before we do this, since pushing will be handled anyhow | 18:30 |
pabelanger | but every before that, we need to vote on our infra spec that is open | 18:30 |
inc0 | can we do docker push to dockerhub before we deal with bits on hosted registry | 18:30 |
inc0 | ? | 18:30 |
inc0 | I need place to store user and password, nothing more | 18:30 |
pabelanger | we need a trusted node, this is the first step | 18:30 |
inc0 | well and node with access to it | 18:30 |
*** krtaylor has joined #openstack-infra | 18:30 | |
*** mat128 has quit IRC | 18:30 | |
pabelanger | otherwise, zuulv3 will support secrets in job | 18:31 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Serve html statically https://review.openstack.org/483503 | 18:31 |
inc0 | but that's still months away right? | 18:31 |
openstackgerrit | Merged openstack-dev/hacking master: Turn on warning-is-error in doc build https://review.openstack.org/482535 | 18:31 |
openstackgerrit | Merged openstack-dev/hacking master: Switch from oslosphinx to openstackdocstheme https://review.openstack.org/482536 | 18:31 |
pabelanger | and was my original suggestion, wait for zuulv3 and we can set it up using secrets | 18:31 |
openstackgerrit | Merged openstack-dev/hacking master: rearrange existing documentation to fit the new standard layout https://review.openstack.org/482537 | 18:31 |
openstackgerrit | Merged openstack-dev/hacking master: Update the doc URL in the documents https://review.openstack.org/482538 | 18:31 |
pabelanger | inc0: we are aiming to move to production for PTG | 18:31 |
fungi | (which technically is still months away) | 18:32 |
inc0 | can I be early adopter? | 18:32 |
mordred | slightly less than 2 months, to be precise | 18:32 |
*** Swami has joined #openstack-infra | 18:32 | |
pabelanger | the docker publisher will likely be after PTG either way, at least for me anyways. Focused on zuulv3 effort | 18:32 |
mordred | 341015 | 18:32 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Run playbooks with only those roles defined thus far https://review.openstack.org/483141 | 18:33 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add child roles before parent https://review.openstack.org/483142 | 18:33 |
inc0 | well, I'm focused on docker publisher;) | 18:33 |
fungi | dhellmann: http://fungi.yuggoth.org/tmp/move_content.sh.txt | 18:33 |
inc0 | so, for me no not just wait | 18:33 |
dhellmann | fungi : looking | 18:33 |
fungi | dhellmann: see if that looks right | 18:33 |
pabelanger | https://review.openstack.org/#/c/447524/ is our infra-spec | 18:33 |
pabelanger | inc0: that would be the first step^ | 18:34 |
inc0 | persistent slave will not be needed with zuulv3 right? | 18:34 |
pabelanger | right | 18:35 |
pabelanger | we could use nodepool for the job, and credentials would be stored in repo | 18:35 |
dhellmann | fungi : lgtm | 18:35 |
inc0 | ok, so I can create periodic job to publish stuff right? and hardcode username/password to some fake registry today? | 18:35 |
*** verdurin has quit IRC | 18:36 | |
dhellmann | fungi : I noticed I forgot to have it include "set -x" so you may want to run it as "bash -x ..." | 18:36 |
sbezverk | hello infra team, appreciate if you could review this small change. https://review.openstack.org/483479 | 18:36 |
dhellmann | depending on how much you like to watch script log output :-) | 18:36 |
inc0 | and after that we'll just switch addresses/creds? | 18:36 |
*** eranrom has quit IRC | 18:36 | |
pabelanger | we'd likely have the job in a trusted repo, so people could just decrypt secrects and echo them | 18:36 |
*** watersoul has quit IRC | 18:37 | |
fungi | dhellmann: will do, thanks for the suggestion | 18:37 |
*** jamielennox has joined #openstack-infra | 18:37 | |
sbezverk | dhellmann : btw thanks a lot for yesterday's help with cliff!! Everything works like a charm now :) | 18:37 |
pabelanger | inc0: yes, you could experiment with that | 18:37 |
dhellmann | sbezverk : great! | 18:37 |
*** rbrndt has joined #openstack-infra | 18:37 | |
*** watersoul has joined #openstack-infra | 18:37 | |
inc0 | ok that works thanks | 18:37 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Support relative urls in success-url https://review.openstack.org/481342 | 18:38 |
*** pcaruana has joined #openstack-infra | 18:38 | |
fungi | dhellmann: it's running. mildly worried that if it throws any errors the -x output will make them impossible to spot though | 18:41 |
dhellmann | fungi : oh, hrm. hadn't thought of that. | 18:42 |
fungi | i redirected stdout to a local file, forgetting that -x outputs on a different fd | 18:42 |
fungi | anyway, the script has completed now. scrolling through the screen buffer i'm not seeing any obvious errors | 18:42 |
dhellmann | good | 18:43 |
fungi | dhellmann: did you set yourself up with local openafs client access so you can view this? | 18:43 |
dhellmann | yeah, I'm looking now | 18:43 |
dhellmann | hmm | 18:43 |
fungi | you're able to see the contents of /afs/.openstack.org/docs presumably? | 18:44 |
dhellmann | oh, yeah, I was looking at the path without the . | 18:44 |
*** thorst has quit IRC | 18:44 | |
dhellmann | a spot check is looking good | 18:44 |
fungi | yeah i'm checking for random paths that should have moved | 18:45 |
fungi | so far so good | 18:45 |
dhellmann | agreed | 18:46 |
dhellmann | I also am not seeing any versioned directories within latest directories | 18:46 |
dhellmann | hmm, that wildcard ls may not have been wise | 18:47 |
fungi | heh | 18:47 |
dhellmann | the shell hung evaluating ls /afs/.openstack.org/docs/*/latest/[0-9]* | 18:47 |
fungi | i'm rerunning gen_move_content.sh to make sure it's empty | 18:48 |
dhellmann | oh, good call | 18:48 |
fungi | well, empty save for comment lines and blank lines anyway | 18:48 |
dhellmann | yeah | 18:49 |
*** trown|lunch is now known as trown | 18:49 | |
fungi | that doesn't necessarily tell us that everything moved successfully, but will tell us if anything was left behind at least (and excepting weird bugs that should mean they moved) | 18:49 |
fungi | yep, just comments and blank lines | 18:50 |
dhellmann | ok, I feel pretty good about the results | 18:50 |
openstackgerrit | Merged openstack-infra/zuul-jobs master: Use package module to install bindep packages https://review.openstack.org/482584 | 18:50 |
fungi | AJaeger: did you want to double-check any of this, if you're still around/awake? | 18:50 |
dhellmann | if anything did go wrong, we should be able to recover by moving the misdirected stuff, but I'm not finding anything in the wrong place | 18:51 |
dhellmann | fungi : do we have space to leave the content in /docs/developer for now? | 18:51 |
dhellmann | just in case we missed something | 18:51 |
* dhellmann is scared to run df on an afs volume | 18:52 | |
fungi | i'm curious what's still left in there... checking now | 18:53 |
dhellmann | it should be the docs built from master from before projects changed their doc jobs | 18:53 |
dhellmann | anything for which there was already a /latest directory in the new structure | 18:53 |
dhellmann | if there wasn't a /latest I had the script at least move the old content over | 18:54 |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: WIP Testing changes required to move 3nodes job to quickstart https://review.openstack.org/483077 | 18:54 |
*** harlowja has joined #openstack-infra | 18:54 | |
dhellmann | for example /afs/.openstack.org/docs/developer/anchor moved to /afs/.openstack.org/docs/anchor/latest | 18:54 |
dhellmann | but there's still a /afs/.openstack.org/docs/developer/nova | 18:55 |
AJaeger | fungi: no, I just expect it works ;) | 18:55 |
dhellmann | in a few weeks, I think we can just remove everything under /afs/.openstack.org/docs/developer/ because it will be stale and not associated with a version | 18:55 |
fungi | i'm getting the subtree size on it from a machine next door to the server... 1.1G remaining in developer | 18:55 |
dhellmann | but I do want to give us a little runtime on the new stuff first | 18:56 |
dhellmann | s/new stuff/new layout/ | 18:56 |
dhellmann | fungi : is there some sort of "commit" step to take to make the changes visible to the read-only volume? Is that what you were talking about turning off before? | 18:57 |
AJaeger | jhesketh: are you going to retire the remaining repos? http://lists.openstack.org/pipermail/openstack-infra/2017-July/005487.html or will anybody else take care of these? | 18:57 |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Support relative urls in success-url https://review.openstack.org/481342 | 18:58 |
AJaeger | dhellmann: yes, there's an afs "commit" for that | 18:58 |
dhellmann | k | 18:58 |
fungi | dhellmann: yep, i was just checking our quota before i manually run a vos release (that will update the read-only volume) and then reenable normal operations | 18:58 |
dhellmann | ++ | 18:58 |
*** aviau has quit IRC | 18:59 | |
dhellmann | this shouldn't have introduced any more content, right? | 18:59 |
*** aviau has joined #openstack-infra | 18:59 | |
fungi | jeblair: what's the docs.dev volume used for? is that the developer.o.o site? | 19:00 |
fungi | dhellmann: right | 19:00 |
*** chandankumar has quit IRC | 19:00 | |
fungi | dhellmann: anyway, we're only 20% used on the docs volume quota, so not too worries | 19:02 |
dhellmann | fungi : oh, good. like I said, we should be able to delete that /developer dir in short order | 19:02 |
fungi | yep | 19:03 |
fungi | okay, i'm going to manually vos release here in a moment | 19:03 |
* dhellmann braces | 19:04 | |
fungi | it's going | 19:04 |
*** nicolasbock has quit IRC | 19:04 | |
dhellmann | how does this work? should changes trickle in, or is it all at once? | 19:05 |
*** eranrom has joined #openstack-infra | 19:05 | |
fungi | it's basically all at once | 19:05 |
*** jaosorior has quit IRC | 19:05 | |
dhellmann | ok, yeah, I see the changes now | 19:05 |
*** tosky has joined #openstack-infra | 19:06 | |
dhellmann | wonderful; I will draft an email announcing that the content has moved. | 19:06 |
openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Serve html statically https://review.openstack.org/483503 | 19:06 |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: WIP: Add settings for ovb in rdocloud https://review.openstack.org/480950 | 19:07 |
fungi | jeblair: nevermind my question about the docs.dev volume. i remembered the fs lv command and confirmed that's what it's for | 19:07 |
AJaeger | TheJulia: could you review https://review.openstack.org/482885 , please? I'd like some bifrost core review | 19:08 |
fungi | #status log docs maintenance is complete and afsdb01 puppet and vos release cronjob have been reenabled | 19:09 |
openstackstatus | fungi: finished logging | 19:09 |
dhellmann | #success documentation for old releases has been restored to docs.openstack.org/$project/$version | 19:11 |
openstackstatus | dhellmann: Added success to Success page | 19:11 |
dhellmann | fungi : thanks as always for your help! | 19:11 |
fungi | dhellmann: thanks for making it easy! | 19:11 |
*** camunoz has quit IRC | 19:12 | |
*** camunoz has joined #openstack-infra | 19:12 | |
AJaeger | thanks, fungi and dhellmann ! | 19:12 |
*** verdurin has joined #openstack-infra | 19:15 | |
*** slaweq has joined #openstack-infra | 19:18 | |
TheJulia | AJaeger: Done :) | 19:20 |
AJaeger | thanks, TheJulia | 19:20 |
*** sbezverk has quit IRC | 19:21 | |
*** sbezverk has joined #openstack-infra | 19:22 | |
*** slaweq has quit IRC | 19:23 | |
*** mat128 has joined #openstack-infra | 19:24 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking master: Updated from global requirements https://review.openstack.org/440029 | 19:27 |
*** florianf has quit IRC | 19:33 | |
openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Add caching reverse proxy for pypi mirror https://review.openstack.org/476289 | 19:36 |
clarkb | fungi: pabelanger ^ that is rebaesd to accomodate the tarballs proxy caching | 19:36 |
clarkb | would be neat t oget that in so that we can compare performance of that to performance of afs caching | 19:36 |
clarkb | anything I can review real quick while I've got a chance? | 19:37 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Remove run-cover role https://review.openstack.org/483527 | 19:37 |
*** ekcs has joined #openstack-infra | 19:38 | |
*** slaweq has joined #openstack-infra | 19:38 | |
ekcs | Hi all. I’m looking to add a python35 version of this dsvm job and make it non-voting. Any suggestions for an example I can model after? Thanks so much. https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/projects.yaml#L1428 | 19:39 |
clarkb | ekcs: https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/devstack-gate.yaml#n695 is the base py35 tempest job | 19:43 |
pabelanger | clarkb: +2 | 19:43 |
openstackgerrit | Serguei Bezverkhi proposed openstack-infra/project-config master: Adding to kolla-kubernetes jobs to test master https://review.openstack.org/483479 | 19:43 |
ekcs | thanks a lot clarkb very helpful. looks like the main thing that needs to change is: export DEVSTACK_GATE_USE_PYTHON3=True right? | 19:44 |
clarkb | ekcs: yup and disable services that are not yet python3 ready | 19:45 |
ekcs | got it. thanks so much. | 19:45 |
dirk | clarkb: could you review https://review.openstack.org/#/c/468117/ ? we're missing the logging config for a week already.. | 19:45 |
clarkb | dirk: looks like bluebox managed to sneak back in there? I think we may want to rerun the log format generator to not have bluebox. I will leave a comment | 19:46 |
*** eranrom has quit IRC | 19:47 | |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Serve html statically https://review.openstack.org/483503 | 19:47 |
*** slaweq has quit IRC | 19:49 | |
*** slaweq has joined #openstack-infra | 19:50 | |
openstackgerrit | Merged openstack-dev/pbr master: Update URLs in documents according to document migration https://review.openstack.org/483181 | 19:50 |
sbezverk | AJaeger would it be ok now? https://review.openstack.org/#/c/483479/ | 19:50 |
fungi | clarkb: i have a couple simple puppet changes under topic:ptgbot if you're interested | 19:51 |
fungi | remaining cleanup to get the bot running correctly | 19:51 |
openstackgerrit | Dirk Mueller proposed openstack-infra/system-config master: Prepare nodepool-builder logging config for openSUSE 42.3 https://review.openstack.org/468117 | 19:52 |
dirk | clarkb: rebased, once more please | 19:52 |
*** pcaruana has quit IRC | 19:52 | |
*** makowals_ has quit IRC | 19:52 | |
clarkb | dirk: +2 | 19:52 |
dirk | pabelanger: fungi : could one of you please +3 https://review.openstack.org/468117 ? | 19:53 |
dirk | clarkb: thx | 19:53 |
*** Apoorva_ has joined #openstack-infra | 19:54 | |
*** rhallisey has quit IRC | 19:55 | |
*** Apoorva has quit IRC | 19:57 | |
openstackgerrit | Merged openstack-infra/infra-specs master: Ansible Puppet Apply is implemented https://review.openstack.org/478610 | 19:57 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Serve html statically https://review.openstack.org/483503 | 19:59 |
*** dmsimard|afk is now known as dmsimard | 20:00 | |
openstackgerrit | Merged openstack-infra/system-config master: Instructions for registering up a new IRC bot nick https://review.openstack.org/482358 | 20:02 |
*** armax has quit IRC | 20:03 | |
openstackgerrit | Eric Kao proposed openstack-infra/project-config master: enable nv py35 dsvm job for congress https://review.openstack.org/483534 | 20:05 |
*** makowals has joined #openstack-infra | 20:06 | |
openstackgerrit | Merged openstack-infra/system-config master: Prepare nodepool-builder logging config for openSUSE 42.3 https://review.openstack.org/468117 | 20:06 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Serve html statically https://review.openstack.org/483503 | 20:09 |
*** mat128 has quit IRC | 20:18 | |
*** harlowja has quit IRC | 20:19 | |
*** timolo has joined #openstack-infra | 20:20 | |
fungi | jerryz: sorry for the delay, i've added you to both groups now | 20:22 |
*** harlowja has joined #openstack-infra | 20:22 | |
*** slaweq has quit IRC | 20:26 | |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: WIP Testing changes required to move 3nodes job to quickstart https://review.openstack.org/483077 | 20:27 |
*** Goneri has quit IRC | 20:28 | |
*** sshnaidm is now known as sshnaidm|off | 20:30 | |
openstackgerrit | Merged openstack-infra/infra-specs master: Gerrit ContactStore Removal https://review.openstack.org/479058 | 20:31 |
openstackgerrit | Merged openstack-infra/system-config master: Add caching reverse proxy for pypi mirror https://review.openstack.org/476289 | 20:31 |
*** timolo has quit IRC | 20:32 | |
*** EricGonczer_ has joined #openstack-infra | 20:33 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/infra-specs master: Make Gerrit contactstore removal a priority https://review.openstack.org/479887 | 20:38 |
openstackgerrit | Merged openstack-infra/puppet-ptgbot master: Correct the db_filename path https://review.openstack.org/483124 | 20:38 |
openstackgerrit | Merged openstack-infra/puppet-ptgbot master: Make HTML and Javascript files world readable https://review.openstack.org/483125 | 20:41 |
*** krtaylor has quit IRC | 20:41 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: DNM - add upper-constraints to tox https://review.openstack.org/483548 | 20:43 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: DNM - add upper-constraints to tox https://review.openstack.org/483548 | 20:43 |
openstackgerrit | Merged openstack-infra/infra-specs master: Make Gerrit contactstore removal a priority https://review.openstack.org/479887 | 20:44 |
*** armax has joined #openstack-infra | 20:45 | |
*** wolverineav has joined #openstack-infra | 20:45 | |
*** wolverin_ has joined #openstack-infra | 20:49 | |
*** wolverineav has quit IRC | 20:50 | |
*** dprince has quit IRC | 20:50 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/project-config master: scripts: jenkins-sudo-grep: Look at /var/log/messages for sudo logs https://review.openstack.org/483549 | 20:50 |
openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder master: opensuse-minimal: install glibc-locale https://review.openstack.org/473959 | 20:50 |
openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder master: zypper-minimal: No point in preserving the environment here https://review.openstack.org/483550 | 20:51 |
*** chlong has quit IRC | 20:52 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add documentation for project shadowing https://review.openstack.org/483552 | 20:52 |
*** wolverin_ has quit IRC | 20:53 | |
openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Zuulv3: zuul-jobs should shadow project-config https://review.openstack.org/483553 | 20:53 |
jeblair | mordred, pabelanger, clarkb: ^ it would be swell to land that soon. | 20:54 |
openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder master: opensuse-minimal: install glibc-locale https://review.openstack.org/473959 | 20:54 |
*** camunoz has quit IRC | 20:56 | |
*** wolverineav has joined #openstack-infra | 20:56 | |
mordred | jeblair: hrm. that seems backwards to me - but that's probably just because my brain doesn't work | 20:56 |
mordred | jeblair: oh - nevermind. my brain read it again and now it makes sense | 20:57 |
tonyb | mordred: do you care about py26 support for sahde(master)? [sorry for the question out of the blue] | 20:58 |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: Add job.name to upload-logs role https://review.openstack.org/483556 | 20:59 |
pabelanger | jeblair: mordred: ^ adds back job.name into our logs.o.o URLs | 20:59 |
pabelanger | working on project-config zuul.yaml change now | 20:59 |
*** wolverineav has quit IRC | 21:00 | |
*** wolverineav has joined #openstack-infra | 21:00 | |
*** makowals has quit IRC | 21:02 | |
*** vhosakot_ has quit IRC | 21:05 | |
openstackgerrit | Merged openstack-infra/project-config master: Zuulv3: zuul-jobs should shadow project-config https://review.openstack.org/483553 | 21:06 |
*** jascott1 has quit IRC | 21:06 | |
*** pradk has left #openstack-infra | 21:07 | |
*** jascott1 has joined #openstack-infra | 21:07 | |
*** jascott1_ has joined #openstack-infra | 21:10 | |
*** jascott1 has quit IRC | 21:10 | |
*** esberglu has quit IRC | 21:12 | |
*** jascott1_ has quit IRC | 21:14 | |
*** ldnunes has quit IRC | 21:16 | |
openstackgerrit | Merged openstack-infra/openstack-zuul-roles master: Add job.name to upload-logs role https://review.openstack.org/483556 | 21:16 |
*** jascott1 has joined #openstack-infra | 21:17 | |
*** jascott1 has quit IRC | 21:22 | |
*** makowals has joined #openstack-infra | 21:22 | |
*** zzzeek has quit IRC | 21:22 | |
*** zzzeek has joined #openstack-infra | 21:24 | |
*** askb has joined #openstack-infra | 21:25 | |
*** krtaylor has joined #openstack-infra | 21:25 | |
*** esberglu has joined #openstack-infra | 21:26 | |
*** makowals has quit IRC | 21:28 | |
*** Apoorva_ has quit IRC | 21:29 | |
*** Apoorva has joined #openstack-infra | 21:30 | |
sbezverk | any chance somebody could review it please? https://review.openstack.org/#/c/483479/ | 21:31 |
*** Guest36023 has quit IRC | 21:36 | |
pabelanger | jeblair: for http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul.yaml#n43 is {job.name} the value I now want? | 21:37 |
pabelanger | not sure where those values are taken from | 21:37 |
jeblair | pabelanger: if you're not sure about things you're changing on the base job, use the base-test job to try it out. | 21:37 |
pabelanger | jeblair: k | 21:38 |
jeblair | pabelanger: but this is actually the area that i'm working on right now, so would you mind yielding to me? | 21:38 |
pabelanger | jeblair: not a problem | 21:38 |
jeblair | pabelanger: if you broke the base job, let's just land a revert | 21:38 |
*** wolverineav has quit IRC | 21:39 | |
pabelanger | jeblair: ya, URLs are not current ATM for gerrit comments. So let me get up a revert until you land your work | 21:39 |
jeblair | pabelanger: oh, no that's fine i don't care about that | 21:39 |
jeblair | i only care if the job is broken | 21:39 |
pabelanger | k | 21:39 |
pabelanger | ya, jobs still work | 21:39 |
jeblair | ok. then leave the rest to me. | 21:40 |
pabelanger | ack | 21:40 |
openstackgerrit | Merged openstack-infra/project-config master: Adding to kolla-kubernetes jobs to test master https://review.openstack.org/483479 | 21:41 |
*** wolverineav has joined #openstack-infra | 21:41 | |
mriedem | seeing a lot of urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool failures in jobs this week | 21:42 |
*** thorst has joined #openstack-infra | 21:42 | |
*** jaypipes has quit IRC | 21:42 | |
openstackgerrit | Merged openstack-infra/irc-meetings master: update time, tony's back https://review.openstack.org/482803 | 21:46 |
*** gouthamr has quit IRC | 21:47 | |
*** SumitNaiksatam has quit IRC | 21:47 | |
*** thorst has quit IRC | 21:48 | |
openstackgerrit | Leticia Wanderley proposed openstack-infra/project-config master: Keystone CI job using ldap domain specific driver https://review.openstack.org/483576 | 21:49 |
*** gouthamr has joined #openstack-infra | 21:49 | |
*** sree has joined #openstack-infra | 21:51 | |
*** wolverineav has quit IRC | 21:52 | |
*** claudiub has quit IRC | 21:55 | |
fungi | EmilienM: looks like https://review.openstack.org/459993 was missing a depends-on https://review.openstack.org/459762 and so merged prematurely. if for some reason the project-config change doesn't go through soon we need to remember to revert the governance addition | 21:56 |
*** sree has quit IRC | 21:56 | |
*** wolverineav has joined #openstack-infra | 21:56 | |
*** wolverineav has quit IRC | 22:01 | |
*** makowals has joined #openstack-infra | 22:03 | |
*** wolverineav has joined #openstack-infra | 22:04 | |
*** vhosakot has joined #openstack-infra | 22:04 | |
*** andreww has joined #openstack-infra | 22:05 | |
*** mattmceuen has quit IRC | 22:05 | |
*** rhallisey has joined #openstack-infra | 22:06 | |
*** xarses has quit IRC | 22:06 | |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Switch to using setup instead of hostvars https://review.openstack.org/483585 | 22:08 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Switch to using setup instead of hostvars https://review.openstack.org/483585 | 22:08 |
mordred | tonyb: no, I do not | 22:09 |
*** iyamahat has quit IRC | 22:09 | |
*** iyamahat has joined #openstack-infra | 22:09 | |
*** andreww has quit IRC | 22:10 | |
mordred | tonyb: I do not mind accepting simple patches if they fix something for someone, but it's not tested so supporting it isn't a goal - and complex patches that have to do a lot of crazy just for that purpose would be out | 22:10 |
*** gouthamr has quit IRC | 22:10 | |
*** slaweq has joined #openstack-infra | 22:10 | |
*** xarses has joined #openstack-infra | 22:10 | |
*** wolverineav has quit IRC | 22:12 | |
*** Shrews has quit IRC | 22:13 | |
*** Shrews has joined #openstack-infra | 22:13 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Move some base job roles from openstack-zuul-roles https://review.openstack.org/483587 | 22:14 |
openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Update base-test to use new zuul-jobs roles https://review.openstack.org/483591 | 22:16 |
*** dpaterson has quit IRC | 22:17 | |
*** wolverineav has joined #openstack-infra | 22:19 | |
*** bobh has quit IRC | 22:19 | |
*** dpaterson has joined #openstack-infra | 22:20 | |
*** wolverineav has quit IRC | 22:23 | |
*** slaweq has quit IRC | 22:25 | |
*** felipemonteiro_ has quit IRC | 22:27 | |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Filter and print results more comprehensively https://review.openstack.org/483311 | 22:27 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: DNM: use base-test in unittest jobs https://review.openstack.org/483593 | 22:34 |
*** wolverineav has joined #openstack-infra | 22:34 | |
openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Support dynamic dependent pipeline additions https://review.openstack.org/483597 | 22:41 |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Filter and print results more comprehensively https://review.openstack.org/483311 | 22:41 |
*** Guest36023 has joined #openstack-infra | 22:42 | |
*** slaweq has joined #openstack-infra | 22:42 | |
*** abadger1999 has quit IRC | 22:42 | |
*** abadger1999 has joined #openstack-infra | 22:42 | |
*** wolverineav has quit IRC | 22:44 | |
*** baoli has quit IRC | 22:45 | |
*** iyamahat has quit IRC | 22:46 | |
openstackgerrit | Brian Haley proposed openstack-infra/project-config master: Make neutron-multinode job the default https://review.openstack.org/483600 | 22:46 |
*** slaweq has quit IRC | 22:46 | |
*** raunak has joined #openstack-infra | 22:48 | |
*** xarses has quit IRC | 22:48 | |
*** iyamahat has joined #openstack-infra | 22:49 | |
*** wolverineav has joined #openstack-infra | 22:50 | |
openstackgerrit | Merged openstack-infra/zuul-jobs master: Move some base job roles from openstack-zuul-roles https://review.openstack.org/483587 | 22:52 |
*** baoli has joined #openstack-infra | 22:52 | |
*** rossella_ has joined #openstack-infra | 22:54 | |
*** wolverineav has quit IRC | 22:54 | |
*** wolverineav has joined #openstack-infra | 22:56 | |
*** rossella__ has quit IRC | 22:57 | |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: WIP: Add settings for ovb in rdocloud https://review.openstack.org/480950 | 22:58 |
*** EricGonczer_ has quit IRC | 22:59 | |
*** tosky has quit IRC | 23:00 | |
*** wolverineav has quit IRC | 23:03 | |
*** rossella_ has quit IRC | 23:04 | |
*** wolverineav has joined #openstack-infra | 23:05 | |
openstackgerrit | Merged openstack-infra/project-config master: Update base-test to use new zuul-jobs roles https://review.openstack.org/483591 | 23:06 |
*** csomerville has quit IRC | 23:06 | |
*** ihrachys is now known as ihrachys|afk | 23:06 | |
*** slaweq has joined #openstack-infra | 23:08 | |
*** gordc has quit IRC | 23:09 | |
*** rbrndt has quit IRC | 23:09 | |
*** wolverineav has quit IRC | 23:09 | |
*** rbrndt has joined #openstack-infra | 23:09 | |
*** rbrndt has quit IRC | 23:09 | |
fungi | lbragstad: reading your message about the stable branch wedge, have you considered adding stable branch jobs to test keystone-tempest-plugin changes, similar to what is run against tempest itself? http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n17503 | 23:10 |
*** wolverineav has joined #openstack-infra | 23:12 | |
*** slaweq has quit IRC | 23:12 | |
*** jascott1 has joined #openstack-infra | 23:14 | |
NobodyCam | Good afternoon Infra folks ... I have an off the wall question about gerrit and openldap... does anyone know if there is a config directive to add a cert for ldap.. looking for something like "tls_cacertfile=/etc/openldap/cacerts/ldap-ca.crt" | 23:15 |
fungi | NobodyCam: no clue. at least for openstack's gerrit we've never even tried its ldap auth | 23:16 |
NobodyCam | ack :) | 23:16 |
*** bbansal has joined #openstack-infra | 23:16 | |
fungi | NobodyCam: you might try asking in #gerrit but that channel tends to be a bit of a ghost town | 23:16 |
NobodyCam | ahh Yea but I'll try | 23:17 |
bbansal | anyone facing issues with the requirements for requests version? | 23:17 |
fungi | NobodyCam: there's also their https://groups.google.com/forum/#!forum/repo-discuss forum which tends to be more active | 23:17 |
bbansal | CI started failing from today morning | 23:17 |
*** wolverineav has quit IRC | 23:17 | |
NobodyCam | oh awesome thank you fungi :) | 23:17 |
*** wolverineav has joined #openstack-infra | 23:18 | |
bbansal | stack failed because of this issue. | 23:18 |
fungi | bbansal: doesn't ring a bell but there is a #openstack-requirements channel the requirements team uses | 23:19 |
bbansal | thanks, will ask there too. | 23:19 |
fungi | bbansal: without an example failure i can't really tell you much | 23:19 |
bbansal | its weird though, it was working until last night | 23:19 |
*** jcoufal has joined #openstack-infra | 23:20 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: DNM - add upper-constraints to tox https://review.openstack.org/483548 | 23:22 |
tonyb | mordred: There is a review in openstack/requirements that would clean up some the then environment markers which would make running shade on py26 harder. https://review.openstack.org/#/c/483555/ specifically the chnage to futures | 23:25 |
*** rlandy is now known as rlandy|bbl | 23:28 | |
*** Swami has quit IRC | 23:30 | |
*** stakeda has joined #openstack-infra | 23:32 | |
*** wolverineav has quit IRC | 23:33 | |
*** jamesden_ has quit IRC | 23:33 | |
*** hongbin has quit IRC | 23:34 | |
*** jamesdenton has joined #openstack-infra | 23:34 | |
*** jcoufal has quit IRC | 23:35 | |
mordred | tonyb: yah - that doesn't bother me too much - although in general those lines could be changed to "python_version<3" | 23:35 |
mordred | and do the same thing without making it harder on humans who still care about 2.6 | 23:36 |
tonyb | mordred: Thanks. | 23:37 |
*** slaweq has joined #openstack-infra | 23:37 | |
*** makowals has quit IRC | 23:39 | |
*** slaweq has quit IRC | 23:41 | |
*** funzo has quit IRC | 23:42 | |
*** funzo has joined #openstack-infra | 23:42 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: WIP: add environment for tox shell https://review.openstack.org/483608 | 23:43 |
*** jcoufal has joined #openstack-infra | 23:43 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: DNM - add upper-constraints to tox https://review.openstack.org/483548 | 23:43 |
*** jcoufal has quit IRC | 23:47 | |
*** makowals has joined #openstack-infra | 23:48 | |
*** thorst has joined #openstack-infra | 23:48 | |
*** shu-mutou has joined #openstack-infra | 23:54 | |
*** thorst has quit IRC | 23:55 | |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: gzip console log before uploading it https://review.openstack.org/483611 | 23:56 |
mordred | jeblair: ^^ | 23:56 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: WIP: add environment for tox shell https://review.openstack.org/483608 | 23:57 |
*** bbansal has quit IRC | 23:59 | |
jeblair | mordred: i like that approach. | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!