| jogo | clarkb: ^ | 00:01 |
|---|---|---|
| pleia2 | back from conferencing o/ | 00:01 |
| pleia2 | fungi: happy being married :) | 00:02 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Add publisher macro for developer.o.o API/SDK site https://review.openstack.org/92493 | 00:02 |
| *** bhuvan has quit IRC | 00:03 | |
| clarkb | pleia2: wow how many conferenes have you done in the last week? | 00:03 |
| fungi | pleia2: was that a question? ;) | 00:03 |
| fungi | (and thanks!) | 00:03 |
| clarkb | jogo: paste opens fine for me | 00:03 |
| pleia2 | clarkb: heh, just 2, but also took a few days to spend in philly | 00:04 |
| clarkb | jogo: did opening that paste fail or did the contents of the paste generate a 500? | 00:04 |
| pleia2 | fungi: haha! no, it's assumed in the first year ;) | 00:04 |
| clarkb | also who is writing cpp? | 00:04 |
| *** xdmeng has quit IRC | 00:05 | |
| jogo | clarkb: trying to create a new paste fails for me | 00:05 |
| jogo | I can go to paste.o.o but if write something and click 'Paste!' | 00:06 |
| clarkb | jogo: http://paste.openstack.org/show/79267/ works for me | 00:06 |
| clarkb | jogo: maybe you need to clear your caches? | 00:06 |
| *** aconrad has quit IRC | 00:06 | |
| jogo | clarkb: damn that paste didn't work for me | 00:06 |
| jogo | wat it works on my other computer | 00:07 |
| fungi | yeah, i can see it fine too | 00:07 |
| clarkb | jogo: clear your caches | 00:07 |
| fungi | though it does seem a rather round-about way to call iproute2 utilities | 00:07 |
| fungi | you'd be better off just querying the kernel | 00:07 |
| jogo | clarkb: does http://paste.openstack.org/show/79269/ work? | 00:07 |
| *** SumitNaiksatam has quit IRC | 00:08 | |
| fungi | jogo: yes, and it' | 00:08 |
| fungi | s very meta | 00:08 |
| *** jcooley has quit IRC | 00:08 | |
| jogo | hrm this is strange | 00:08 |
| *** mengxd has joined #openstack-infra | 00:08 | |
| jogo | whoa | 00:08 |
| jogo | if I open a incongnito page it works | 00:09 |
| *** mengxd has quit IRC | 00:09 | |
| hogepodge | I probably asked this six months ago, but how do I make a stable branch for a project with Gerrit? | 00:09 |
| fungi | jogo: does http://paste.openstack.org/show/79271/ work for you? | 00:09 |
| *** mengxd has joined #openstack-infra | 00:09 | |
| fungi | (apologies to rené magritte) | 00:09 |
| clarkb | jogo: clear your caches | 00:10 |
| clarkb | hogepodge: find the project in the projects list, go to branches enter a branch name and an initial revision | 00:10 |
| clarkb | hogepodge: this does require extra permissions above what most users get | 00:11 |
| hogepodge | Ah. Thanks. | 00:11 |
| jogo | clarkb: one deleted cookie later it all works | 00:11 |
| jogo | clarkb: odd | 00:11 |
| fungi | jogo: cookies are for eating | 00:11 |
| clarkb | zaro: blazers spurs tonight | 00:12 |
| clarkb | zaro: I am prepared to be very sad, but would be quite happy with a close game | 00:12 |
| *** jcooley has joined #openstack-infra | 00:12 | |
| *** manishg has quit IRC | 00:13 | |
| *** james_li has quit IRC | 00:13 | |
| clarkb | jhesketh: can you ping me tomorrow and remind me to figure out the zuul swift creds derp | 00:13 |
| clarkb | jhesketh: that was on my list today but I ran out of time | 00:13 |
| *** Sukhdev has joined #openstack-infra | 00:14 | |
| jhesketh | clarkb: will do | 00:14 |
| jhesketh | thanks :-) | 00:14 |
| *** dkehnx has quit IRC | 00:14 | |
| *** dkehnx has joined #openstack-infra | 00:14 | |
| *** manishg has joined #openstack-infra | 00:15 | |
| *** james_li has joined #openstack-infra | 00:16 | |
| fungi | jhesketh: i missed where we ended up with https://review.openstack.org/92263 last night. i read the scrollback when i got up this morning, but am unsure whether the results of the continued conversation were accurately reflected in your comments on the change itself. yes? | 00:18 |
| *** manishg has quit IRC | 00:19 | |
| *** matsuhashi has joined #openstack-infra | 00:20 | |
| *** flaper87 is now known as flaper87|afk | 00:20 | |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Zuul parameter ZUUL_URL https://review.openstack.org/87931 | 00:20 |
| *** manishg has joined #openstack-infra | 00:20 | |
| jhesketh | fungi: so I think the main thing is jeblair wants to be sure of the open pipeline requirement | 00:21 |
| jhesketh | so there's some extra testing here https://review.openstack.org/#/c/92269/ | 00:21 |
| *** pcrews has quit IRC | 00:21 | |
| *** jcooley has quit IRC | 00:22 | |
| jhesketh | fungi: as for the layout the suggestion was to add a new test with a realistic layout then once the require-approvals is removed remove the current tests | 00:22 |
| *** jaypipes has joined #openstack-infra | 00:23 | |
| *** aconrad has joined #openstack-infra | 00:24 | |
| *** james_li has quit IRC | 00:26 | |
| fungi | jhesketh: any particular existing config with the old syntax recommended as fodder for switching to the new syntax? | 00:27 |
| fungi | or just grab the most complete one which isn't for a negative test? | 00:27 |
| *** praneshp has quit IRC | 00:28 | |
| *** bknudson has joined #openstack-infra | 00:28 | |
| *** ChristianAkerblo has quit IRC | 00:31 | |
| *** matsuhashi has quit IRC | 00:32 | |
| jhesketh | fungi: I guess the most complete one | 00:32 |
| *** matsuhashi has joined #openstack-infra | 00:33 | |
| jhesketh | the idea will be to make the check and gate pipelines reenqueue how it currently does in production | 00:33 |
| *** SumitNaiksatam has joined #openstack-infra | 00:33 | |
| fungi | yep, okay that makes sense. thanks jhesketh! | 00:34 |
| jhesketh | or at least how it was intended | 00:34 |
| *** lakshmiS has quit IRC | 00:35 | |
| *** SumitNaiksatam has quit IRC | 00:39 | |
| *** ramashri has quit IRC | 00:41 | |
| *** yamahata has joined #openstack-infra | 00:42 | |
| *** aconrad has quit IRC | 00:42 | |
| *** hogepodge has quit IRC | 00:50 | |
| *** reed has quit IRC | 00:51 | |
| zaro | puppetboard.o.o shows that jenkins-dev and review-dev aren't report. anybody know why? | 00:53 |
| zaro | clarkb: i'm a believer, blazers in 6 | 00:54 |
| *** yamahata has quit IRC | 00:55 | |
| *** arnaud__ has quit IRC | 00:57 | |
| *** notmyname has quit IRC | 01:03 | |
| *** david-lyle has joined #openstack-infra | 01:03 | |
| *** notmyname has joined #openstack-infra | 01:06 | |
| *** amcrn has quit IRC | 01:08 | |
| *** Ryan_Lane1 has joined #openstack-infra | 01:09 | |
| *** Ryan_Lane has quit IRC | 01:10 | |
| *** alexpilotti has quit IRC | 01:11 | |
| *** marcoemorais has quit IRC | 01:12 | |
| *** SumitNaiksatam has joined #openstack-infra | 01:13 | |
| *** atiwari has quit IRC | 01:19 | |
| *** saschpe has quit IRC | 01:20 | |
| *** gokrokve_ has quit IRC | 01:21 | |
| *** saschpe has joined #openstack-infra | 01:21 | |
| cody-somerville | What happens when someone adds a requirement on a package that builds c bits that requires headers and libraries already to be installed? How is that handled? | 01:26 |
| openstackgerrit | Dan Prince proposed a change to openstack-infra/config: Add yum.openstack.org lightweight Fedora 20 mirror https://review.openstack.org/90875 | 01:26 |
| openstackgerrit | Dan Prince proposed a change to openstack-infra/config: Add yum mirror support for lightweight mirrors https://review.openstack.org/90874 | 01:26 |
| clarkb | cody-somerville: one of two ways. If the C bits are needed by unittests or doc builds etc then we add them to the jenkins slave package list | 01:27 |
| clarkb | cody-somerville: if the C bits are needed by devstack gate jobs you add the dependencies to devstack | 01:27 |
| clarkb | possible you need to do both | 01:28 |
| *** MarkAtwood has quit IRC | 01:29 | |
| *** lcheng_ has quit IRC | 01:32 | |
| *** yaguang has joined #openstack-infra | 01:34 | |
| *** oomichi has joined #openstack-infra | 01:38 | |
| *** weshay has quit IRC | 01:41 | |
| *** nosnos has joined #openstack-infra | 01:43 | |
| *** signed8bit has joined #openstack-infra | 01:49 | |
| *** Sukhdev_ has joined #openstack-infra | 01:50 | |
| *** Sukhdev has quit IRC | 01:50 | |
| *** Sukhdev has joined #openstack-infra | 01:52 | |
| *** gokrokve has joined #openstack-infra | 01:52 | |
| *** hogepodge has joined #openstack-infra | 01:53 | |
| *** notmyname has quit IRC | 01:54 | |
| *** notmyname has joined #openstack-infra | 01:54 | |
| *** Sukhdev_ has quit IRC | 01:55 | |
| *** Sukhdev has quit IRC | 01:56 | |
| *** zns has joined #openstack-infra | 01:56 | |
| *** david-lyle has quit IRC | 01:57 | |
| *** signed8bit has quit IRC | 02:00 | |
| *** morganfainberg is now known as morganfainberg_Z | 02:04 | |
| *** moted has quit IRC | 02:04 | |
| *** aconrad has joined #openstack-infra | 02:04 | |
| *** mengxd has quit IRC | 02:04 | |
| *** alexpilotti has joined #openstack-infra | 02:07 | |
| *** moted has joined #openstack-infra | 02:09 | |
| *** moted has left #openstack-infra | 02:09 | |
| *** zns has quit IRC | 02:14 | |
| *** signed8bit has joined #openstack-infra | 02:14 | |
| *** alexpilotti has quit IRC | 02:23 | |
| *** zns has joined #openstack-infra | 02:27 | |
| *** Ryan_Lane1 has quit IRC | 02:28 | |
| *** markwash has quit IRC | 02:33 | |
| *** marun has joined #openstack-infra | 02:39 | |
| *** mburned is now known as mburned_out | 02:39 | |
| *** gokrokve_ has joined #openstack-infra | 02:41 | |
| *** jgrimm has joined #openstack-infra | 02:41 | |
| *** gokrokve has quit IRC | 02:44 | |
| *** salv-orlando_ has joined #openstack-infra | 02:45 | |
| *** salv-orlando has quit IRC | 02:48 | |
| *** salv-orlando_ is now known as salv-orlando | 02:48 | |
| jeblair | clarkb, fungi: we'll move everything off of ftp eventually, but it's probably easier if it's all together. i think we'll have a better idea after the summit | 02:49 |
| *** harlowja is now known as harlowja_away | 02:50 | |
| *** praneshp has joined #openstack-infra | 02:51 | |
| *** praneshp_ has joined #openstack-infra | 02:52 | |
| *** yamahata has joined #openstack-infra | 02:52 | |
| *** zhiyan_ is now known as zhiyan | 02:53 | |
| *** thomasem has quit IRC | 02:53 | |
| *** praneshp has quit IRC | 02:56 | |
| *** praneshp_ is now known as praneshp | 02:56 | |
| *** resker has joined #openstack-infra | 02:56 | |
| *** resker has quit IRC | 02:56 | |
| *** harlowja_away has quit IRC | 02:58 | |
| *** esker has quit IRC | 02:59 | |
| *** russell_h has quit IRC | 03:01 | |
| *** clarkb has quit IRC | 03:03 | |
| *** clarkb has joined #openstack-infra | 03:04 | |
| *** signed8bit has quit IRC | 03:07 | |
| *** amotoki has quit IRC | 03:14 | |
| *** zns has quit IRC | 03:15 | |
| *** james_li has joined #openstack-infra | 03:16 | |
| *** zns has joined #openstack-infra | 03:18 | |
| *** zz_gondoi is now known as gondoi | 03:18 | |
| *** Sukhdev has joined #openstack-infra | 03:21 | |
| *** Sukhdev has quit IRC | 03:21 | |
| *** Sukhdev has joined #openstack-infra | 03:21 | |
| *** MarkAtwood has joined #openstack-infra | 03:27 | |
| *** MarkAtwood has quit IRC | 03:27 | |
| *** james_li has quit IRC | 03:27 | |
| *** zns has quit IRC | 03:28 | |
| *** dims has quit IRC | 03:30 | |
| *** reed has joined #openstack-infra | 03:30 | |
| *** marun has quit IRC | 03:31 | |
| *** wenlock has joined #openstack-infra | 03:32 | |
| *** matsuhashi has quit IRC | 03:33 | |
| *** zns has joined #openstack-infra | 03:33 | |
| *** gyee has quit IRC | 03:34 | |
| *** renlt has joined #openstack-infra | 03:36 | |
| *** sdake_ has joined #openstack-infra | 03:37 | |
| *** sdake_ has quit IRC | 03:37 | |
| *** sdake_ has joined #openstack-infra | 03:37 | |
| *** yfried has joined #openstack-infra | 03:39 | |
| *** nosnos has quit IRC | 03:43 | |
| *** reed has quit IRC | 03:43 | |
| *** changbl has joined #openstack-infra | 03:48 | |
| *** manishg has quit IRC | 03:49 | |
| *** signed8bit has joined #openstack-infra | 03:52 | |
| *** marun has joined #openstack-infra | 03:55 | |
| *** amotoki has joined #openstack-infra | 03:56 | |
| clarkb | jeblair: fungi SergeyLukjanov mordred pleia2 sdague any anyone else potentially interested in my cross project session I am starting to throw more specific htings on https://etherpad.openstack.org/p/juno-test-maxtrices | 03:57 |
| clarkb | trying to move it from clarks braindump on topic to useful summit session etherpad | 03:58 |
| *** gondoi is now known as zz_gondoi | 03:59 | |
| *** sdake_ has quit IRC | 04:05 | |
| *** james_li has joined #openstack-infra | 04:06 | |
| *** yfried has quit IRC | 04:07 | |
| *** james_li_ has joined #openstack-infra | 04:08 | |
| *** james_li has quit IRC | 04:10 | |
| *** james_li_ is now known as james_li | 04:10 | |
| *** mburned_out is now known as mburned | 04:12 | |
| *** freyes has quit IRC | 04:19 | |
| *** Longgeek has joined #openstack-infra | 04:19 | |
| *** Longgeek_ has joined #openstack-infra | 04:22 | |
| *** Ryan_Lane has joined #openstack-infra | 04:22 | |
| *** Longgeek has quit IRC | 04:25 | |
| *** Ryan_Lane has quit IRC | 04:26 | |
| *** ramashri has joined #openstack-infra | 04:27 | |
| *** melwitt has joined #openstack-infra | 04:32 | |
| openstackgerrit | Sergey Kolekonov proposed a change to openstack-infra/config: Enable Tempest in Mistral devstack job https://review.openstack.org/92513 | 04:35 |
| *** melwitt1 has joined #openstack-infra | 04:37 | |
| *** melwitt has quit IRC | 04:38 | |
| *** matsuhashi has joined #openstack-infra | 04:39 | |
| *** mdenny has quit IRC | 04:40 | |
| *** ramashri has quit IRC | 04:44 | |
| *** timrc is now known as timrc-afk | 04:46 | |
| *** ildikov has quit IRC | 04:46 | |
| *** Ryan_Lane has joined #openstack-infra | 04:48 | |
| *** melwitt1 is now known as melwitt | 04:49 | |
| *** chandan_kumar has joined #openstack-infra | 04:50 | |
| *** nosnos has joined #openstack-infra | 04:51 | |
| *** jp_at_hp has quit IRC | 04:51 | |
| *** Longgeek has joined #openstack-infra | 04:53 | |
| *** Longgee__ has joined #openstack-infra | 04:54 | |
| *** renlt has quit IRC | 04:54 | |
| *** Longgeek_ has quit IRC | 04:55 | |
| *** Longgeek has quit IRC | 04:58 | |
| *** arnaud__ has joined #openstack-infra | 05:01 | |
| *** james_li has quit IRC | 05:17 | |
| *** arnaud__ has quit IRC | 05:19 | |
| *** Sukhdev has quit IRC | 05:21 | |
| *** arnaud__ has joined #openstack-infra | 05:24 | |
| *** arnaud__ has quit IRC | 05:24 | |
| *** arnaud__ has joined #openstack-infra | 05:24 | |
| *** ildikov has joined #openstack-infra | 05:32 | |
| *** jcoufal has joined #openstack-infra | 05:33 | |
| *** WaltNik has joined #openstack-infra | 05:35 | |
| *** signed8bit has quit IRC | 05:37 | |
| *** afazekas has joined #openstack-infra | 05:38 | |
| *** yfried has joined #openstack-infra | 05:39 | |
| *** salv-orlando has quit IRC | 05:49 | |
| *** yfried has quit IRC | 05:49 | |
| *** yfried has joined #openstack-infra | 05:50 | |
| openstackgerrit | David Ostrovsky proposed a change to openstack-infra/config: Add configuration option to disable top level menu for javamelody plugin https://review.openstack.org/91176 | 06:04 |
| mattoliverau | I'm callingit a day, night all. | 06:23 |
| *** dkehn_ has joined #openstack-infra | 06:25 | |
| *** dkehnx has quit IRC | 06:29 | |
| *** zns has quit IRC | 06:32 | |
| *** hogepodge has quit IRC | 06:35 | |
| *** aconrad has quit IRC | 06:40 | |
| *** _nadya_ has joined #openstack-infra | 06:41 | |
| *** jhesketh has quit IRC | 06:44 | |
| *** _nadya_ has quit IRC | 06:47 | |
| *** _nadya_ has joined #openstack-infra | 06:49 | |
| *** salv-orlando has joined #openstack-infra | 06:49 | |
| *** rcarrill` has joined #openstack-infra | 06:50 | |
| *** imcsk8 has quit IRC | 06:50 | |
| *** imcsk8 has joined #openstack-infra | 06:50 | |
| *** rcarrillocruz has quit IRC | 06:51 | |
| *** imcsk8 has left #openstack-infra | 06:52 | |
| *** imcsk8 has joined #openstack-infra | 06:53 | |
| *** matrohon has joined #openstack-infra | 06:54 | |
| *** jcoufal has quit IRC | 07:00 | |
| *** salv-orlando has quit IRC | 07:01 | |
| *** praneshp has quit IRC | 07:04 | |
| *** jlibosva has joined #openstack-infra | 07:07 | |
| *** tnurlygayanov has quit IRC | 07:11 | |
| *** melwitt has quit IRC | 07:12 | |
| *** tnurlygayanov has joined #openstack-infra | 07:14 | |
| *** flaper87|afk is now known as flaper87 | 07:18 | |
| *** salv-orlando has joined #openstack-infra | 07:21 | |
| *** ihrachyshka has joined #openstack-infra | 07:21 | |
| *** arnaud__ has quit IRC | 07:25 | |
| *** rcarrill` has quit IRC | 07:25 | |
| *** zhiyan is now known as zhiyan_ | 07:26 | |
| *** hashar has joined #openstack-infra | 07:32 | |
| *** skolekonov has joined #openstack-infra | 07:33 | |
| *** wenlock has quit IRC | 07:33 | |
| *** sdake_ has joined #openstack-infra | 07:36 | |
| SpamapS | ruh roh | 07:37 |
| *** jcoufal has joined #openstack-infra | 07:37 | |
| SpamapS | Gerrit throwing errors | 07:37 |
| SpamapS | Cannot open ReviewDb at com.google.gerrit.server.util.ThreadLocalRequestContext$1.provideReviewDb(ThreadLocalRequestContext.java:70) while locating com.google.gerrit.reviewdb.server.ReviewDb | 07:37 |
| ihrachyshka | yeah, same here, just came here to ask | 07:37 |
| SlickNik | yup, can confirm | 07:37 |
| SpamapS | clarkb: awake? | 07:39 |
| SpamapS | mordred: what TZ are you in at the moment? :) | 07:39 |
| *** rcarrillocruz has joined #openstack-infra | 07:42 | |
| *** rlandy has joined #openstack-infra | 07:45 | |
| openstackgerrit | Nikhil Manchanda proposed a change to openstack-infra/reviewstats: Add Craig Vyvial (cp16net) as Trove core reviewer https://review.openstack.org/92530 | 07:46 |
| SlickNik | looks like gerrit is back up for me | 07:47 |
| *** Hal has joined #openstack-infra | 07:47 | |
| SlickNik | ^^ SpamapS / ihrachyshka | 07:47 |
| ihrachyshka | SlickNik: confirmed | 07:48 |
| *** Hal is now known as Guest22352 | 07:48 | |
| *** Hal_ has joined #openstack-infra | 07:48 | |
| *** salv-orlando has quit IRC | 07:52 | |
| *** Guest22352 has quit IRC | 07:52 | |
| SpamapS | darn, it's back up.. another time, pirateslovedaisies.com ... another time.. | 07:58 |
| *** rcarrillocruz has quit IRC | 07:59 | |
| *** jpich has joined #openstack-infra | 07:59 | |
| *** maxbit has quit IRC | 08:03 | |
| *** maxbit has joined #openstack-infra | 08:04 | |
| *** rcarrillocruz has joined #openstack-infra | 08:04 | |
| afazekas | Why I cant see this change https://review.openstack.org/#/c/92018/ here: http://status.openstack.org/zuul/ | 08:04 |
| *** Ryan_Lane has quit IRC | 08:11 | |
| SpamapS | afazekas: may have been lost | 08:11 |
| *** rcarrillocruz has quit IRC | 08:13 | |
| *** markmc has joined #openstack-infra | 08:15 | |
| *** homeless has quit IRC | 08:16 | |
| *** rcarrillocruz has joined #openstack-infra | 08:18 | |
| afazekas | SpamapS: I tried the reverify again | 08:18 |
| *** dizquierdo has joined #openstack-infra | 08:19 | |
| *** derekh_ has joined #openstack-infra | 08:20 | |
| SpamapS | cool | 08:20 |
| * SpamapS goes to bed | 08:20 | |
| *** jp_at_hp has joined #openstack-infra | 08:21 | |
| *** arnaud__ has joined #openstack-infra | 08:26 | |
| *** sahid has quit IRC | 08:29 | |
| *** arnaud__ has quit IRC | 08:30 | |
| *** BobBall_Away is now known as BobBall | 08:33 | |
| *** BobBall is now known as Guest88183 | 08:33 | |
| yfried | fungi: clarkb: jesusaurus: anyone here? | 08:36 |
| yfried | I'm trying to query kibana for all tests that failed due to SSH timeout and I'm getting lost with the GUI | 08:36 |
| afazekas | It is Still not in the queue :( | 08:39 |
| *** salv-orlando has joined #openstack-infra | 08:44 | |
| *** jooools has joined #openstack-infra | 08:45 | |
| *** salv-orlando has quit IRC | 08:51 | |
| jlibosva | is communication between gerrit and Jenkins working? I can see a lot of finished checks on zuul but not reporting back to gerrit. Also retrigerring jobs seems not working. | 08:52 |
| *** pblaho has joined #openstack-infra | 08:52 | |
| *** miarmak_ has quit IRC | 08:56 | |
| *** andreaf has joined #openstack-infra | 08:58 | |
| *** miarmak has joined #openstack-infra | 09:00 | |
| *** Steap has quit IRC | 09:00 | |
| *** miarmak has quit IRC | 09:01 | |
| *** miarmak has joined #openstack-infra | 09:01 | |
| *** Steap has joined #openstack-infra | 09:01 | |
| *** Guest88183 is now known as BobBall | 09:12 | |
| *** che-arne has joined #openstack-infra | 09:14 | |
| *** chandan_kumar has quit IRC | 09:17 | |
| *** chandan_kumar has joined #openstack-infra | 09:23 | |
| *** darraghb has joined #openstack-infra | 09:26 | |
| hashar | jlibosva: it is stalled apparently. At the top of Zuul status page http://status.openstack.org/zuul/ you can see : Queue lengths: 349 events, 198 results. | 09:32 |
| hashar | the result queue (198 items) are results that have to be processed back to Gerrit | 09:32 |
| hashar | seems it went on stale ~ 3 hours ago | 09:32 |
| hashar | the events queue keep increasing suggesting that the Gerrit - Zuul communications works | 09:33 |
| hashar | ttx: hi, do you have any infra folks available during european mornings? Zuul gearman server is stalled somehow | 09:34 |
| *** asettle has quit IRC | 09:34 | |
| ttx | hashar: I don't think we have any this week | 09:38 |
| hashar | mailing list openstack-infra list so :-D | 09:38 |
| *** matsuhashi has quit IRC | 09:41 | |
| *** matsuhas_ has joined #openstack-infra | 09:42 | |
| *** e0ne has joined #openstack-infra | 09:43 | |
| *** jgallard has joined #openstack-infra | 09:45 | |
| *** chandan_kumar has quit IRC | 09:46 | |
| *** gokrokve_ has quit IRC | 09:50 | |
| *** gokrokve has joined #openstack-infra | 09:50 | |
| *** gokrokve has quit IRC | 09:50 | |
| *** _nadya_ has quit IRC | 09:56 | |
| jlibosva | hashar: thanks :) | 09:57 |
| hashar | jlibosva: i am afraid we have to wait for US East coasters to wake up | 09:58 |
| jlibosva | hashar: if the results are queued, they won't get lost after issue is resolved, right? | 09:59 |
| *** chandan_kumar has joined #openstack-infra | 10:00 | |
| hashar | jlibosva: it depends on root cause. If Zuul needs to be killed, the results will be lost | 10:00 |
| hashar | hopefully it is not that severe | 10:00 |
| jlibosva | fingers crossed | 10:01 |
| *** michchap has quit IRC | 10:09 | |
| *** matsuhas_ has quit IRC | 10:09 | |
| *** dims has joined #openstack-infra | 10:10 | |
| *** dims has quit IRC | 10:10 | |
| *** michchap has joined #openstack-infra | 10:10 | |
| *** dims has joined #openstack-infra | 10:10 | |
| *** matsuhashi has joined #openstack-infra | 10:10 | |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/gear: Use Job repr instead of handle in Client debug log https://review.openstack.org/86596 | 10:12 |
| *** xchu has quit IRC | 10:16 | |
| *** jgallard has quit IRC | 10:17 | |
| sdague | yeh, it looks like zuul is dead | 10:20 |
| *** matsuhashi has quit IRC | 10:21 | |
| *** matsuhashi has joined #openstack-infra | 10:22 | |
| hashar | sdague: good morning :] | 10:23 |
| hashar | sdague: Gerrit went down earlier today might be part of the issue | 10:23 |
| hashar | at 7:38am UTC Spamaps reported : Cannot open ReviewDb at com.google.gerrit.server.util.ThreadLocalRequestContext$1.provideReviewDb(ThreadLocalRequestContext.java:70) while locating com.google.gerrit.reviewdb.server.ReviewDb | 10:24 |
| *** gokrokve has joined #openstack-infra | 10:38 | |
| *** lxsli has quit IRC | 10:42 | |
| *** gokrokve has quit IRC | 10:43 | |
| *** yamahata has quit IRC | 10:43 | |
| *** rcarrill` has joined #openstack-infra | 10:51 | |
| *** rcarrillocruz has quit IRC | 10:53 | |
| *** hashar has quit IRC | 10:54 | |
| *** jcoufal has quit IRC | 10:54 | |
| *** jcoufal has joined #openstack-infra | 10:56 | |
| *** jlibosva has quit IRC | 10:57 | |
| StevenK | Huh, it looks like zuul isn't actually reaping results | 11:00 |
| *** jlibosva has joined #openstack-infra | 11:00 | |
| *** Longgee__ has quit IRC | 11:03 | |
| sdague | yeh, zuul's not doing anything right now | 11:08 |
| *** Longgeek has joined #openstack-infra | 11:10 | |
| *** dims has quit IRC | 11:11 | |
| *** jlibosva has quit IRC | 11:22 | |
| *** jlibosva has joined #openstack-infra | 11:22 | |
| *** yaguang has quit IRC | 11:32 | |
| *** gokrokve has joined #openstack-infra | 11:37 | |
| *** mbacchi has quit IRC | 11:38 | |
| *** jamielennox is now known as jamielennox|away | 11:40 | |
| openstackgerrit | Andreas Jaeger proposed a change to openstack-infra/config: Publish troveclient documentation https://review.openstack.org/92562 | 11:40 |
| ttx | etherpad.o.o isn't exactly in a stellar shape right now either | 11:41 |
| openstackgerrit | Andreas Jaeger proposed a change to openstack-infra/config: Publish troveclient documentation https://review.openstack.org/92562 | 11:41 |
| *** gokrokve has quit IRC | 11:42 | |
| *** ildikov is now known as ildikov_afk | 11:43 | |
| *** vhoward has joined #openstack-infra | 11:45 | |
| *** lxsli has joined #openstack-infra | 11:45 | |
| lxsli | Hi, I heard that Gerrit short review numbers were going away, anyone got a relevant link please? | 11:46 |
| *** ildikov_afk has quit IRC | 11:46 | |
| *** ociuhandu has joined #openstack-infra | 11:50 | |
| *** Longgeek has quit IRC | 11:51 | |
| *** Longgeek has joined #openstack-infra | 11:51 | |
| *** rcarrillocruz has joined #openstack-infra | 11:54 | |
| *** sandywalsh has quit IRC | 11:55 | |
| *** flaper87 is now known as flaper87|afk | 11:56 | |
| *** rcarrill` has quit IRC | 11:57 | |
| *** flaper87|afk is now known as flaper87 | 11:57 | |
| *** adalbas has joined #openstack-infra | 11:58 | |
| *** jgrimm has quit IRC | 11:59 | |
| *** amotoki has quit IRC | 11:59 | |
| *** pblaho has quit IRC | 12:02 | |
| openstackgerrit | Peter Belanyi proposed a change to openstack-infra/config: Add selenium job for tuskar-ui https://review.openstack.org/92568 | 12:06 |
| *** mwagner_ has quit IRC | 12:09 | |
| *** ArxCruz has joined #openstack-infra | 12:16 | |
| *** mbacchi has joined #openstack-infra | 12:16 | |
| *** pdmars has joined #openstack-infra | 12:18 | |
| *** dkehn_ is now known as dkehnx | 12:18 | |
| *** pdmars has quit IRC | 12:20 | |
| *** dprince has joined #openstack-infra | 12:22 | |
| sdague | is fungi on or off this week? | 12:26 |
| *** aysyd has joined #openstack-infra | 12:26 | |
| jeblair | sdague: fungi is on. i am off. but i'm digging into zuul | 12:26 |
| *** eharney has quit IRC | 12:27 | |
| *** hashar has joined #openstack-infra | 12:27 | |
| *** miqui has joined #openstack-infra | 12:27 | |
| *** yamahata has joined #openstack-infra | 12:28 | |
| *** pdmars has joined #openstack-infra | 12:28 | |
| jeblair | hashar: there we go: http://paste.openstack.org/show/79377/ | 12:29 |
| jeblair | hashar: it does look like it's related to gerrit being unresponsive | 12:29 |
| hashar | hello! | 12:29 |
| *** weshay has joined #openstack-infra | 12:30 | |
| hashar | do you find that using the thread dumps function in Zuul (SIGUSR2 iirc? ) | 12:30 |
| *** WaltNik has quit IRC | 12:30 | |
| jeblair | hashar: yep | 12:30 |
| *** WaltNik has joined #openstack-infra | 12:30 | |
| ttx | anyone else having issues with etherpads ? Could be a general responsiveness issue | 12:31 |
| jeblair | http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=34&rra_id=0&view_type=tree&graph_start=1399445678&graph_end=1399452231&graph_height=120&graph_width=500&title_font_size=10 | 12:32 |
| dolphm | ttx: it's been really slow for me on and off for a few days | 12:32 |
| jeblair | hashar: i see a drop in eth1 traffic on review.o.o around 7:35 | 12:32 |
| *** rfolco has joined #openstack-infra | 12:32 | |
| hashar | jeblair: yeah Gerrit seems to have died around that time. | 12:32 |
| jeblair | eth1 is the _internal_ network, which is now the network gerrit uses to talk to its database which is hosted on trove | 12:33 |
| *** yamahata has quit IRC | 12:33 | |
| hashar | I lost this channel backlog but got reported at 5:40am UTC | 12:33 |
| *** aysyd has quit IRC | 12:34 | |
| hashar | seems the ssh connection is held and never timeout :-( | 12:35 |
| jeblair | hrm, the tcp connections on both servers match up... | 12:36 |
| *** gokrokve has joined #openstack-infra | 12:38 | |
| *** dprince has quit IRC | 12:38 | |
| jeblair | 2014-05-07 07:36:53,793 DEBUG zuul.reporter.gerrit.Reporter: Report change <Change 0x7faeadef5f50 91171,11>, params {'verified': 1}, message: Build succeeded. | 12:38 |
| hashar | so that would be Gerrit not being able to process the commands | 12:39 |
| hashar | might want to dig in Gerrit log | 12:39 |
| jeblair | that's the report it's stuck on; i don't have any more information on that | 12:39 |
| *** dpyzhov has joined #openstack-infra | 12:40 | |
| dpyzhov | hi | 12:40 |
| dpyzhov | gettit merge jobs are down? | 12:40 |
| jeblair | that will take a minute since gerrit likes to log full stack traces every time someone disconnects | 12:40 |
| dpyzhov | *gerrit | 12:40 |
| jeblair | [2014-05-07 07:36:32,323] ERROR com.google.gerrit.server.query.change.QueryProcessor : Cannot execute query: ... | 12:41 |
| jeblair | Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure | 12:41 |
| *** gokrokve has quit IRC | 12:42 | |
| hashar | dpyzhov: yup Zuul is blocked right now | 12:43 |
| dpyzhov | hashar: thanks. any estimates? | 12:43 |
| hashar | dpyzhov: being looked at ;) | 12:43 |
| hashar | jeblair: hopefully the events blocked by Gerrit communication are still in the event queue. Maybe SIGUSR1 would save them all and reemit them on restart? | 12:46 |
| hashar | though the doc says "wait until all executing jobs are finished" | 12:46 |
| hashar | and the status page show a bunch of them running | 12:46 |
| jeblair | [2014-05-07 07:36:53,880] WARN com.google.gerrit.sshd.CommandFactoryProvider : Cannot start command "gerrit review --project opensta | 12:46 |
| jeblair | ck/taskflow --message "Build succeeded. | 12:46 |
| hashar | :-( | 12:46 |
| *** maxired has joined #openstack-infra | 12:47 | |
| jeblair | so it did log that error, but no other information about what the connection might be doing | 12:47 |
| jeblair | the bad news is i have no idea what the state of that ssh connection is or why it's stuck; the good news is i think there's a reasonable chance we could reproduce this in a test env simply by disconnecting gerrit's database | 12:48 |
| jeblair | so we might be able to have zuul handle this better | 12:48 |
| maxired | Hi folks | 12:49 |
| hashar | jeblair: what the exception message is saying? | 12:49 |
| jeblair | hashar: i don't believe there's a way to save that event queue. we'll | 12:49 |
| jeblair | we can save the jobs already running and reenqueue those, but the rest will just be lost :( | 12:49 |
| *** aysyd has joined #openstack-infra | 12:49 | |
| hashar | well SIGUSR1 is supposed to save the queue though | 12:50 |
| jeblair | hashar: http://paste.openstack.org/show/79379/ | 12:50 |
| *** jgrimm has joined #openstack-infra | 12:50 | |
| maxired | I try to setup my gerrit account, but i got an error when i want set/update my contact information in https://review.openstack.org/#/settings/contact | 12:50 |
| hashar | not sure how to cause the currently running jobs to be marked as finished | 12:50 |
| *** lcostantino has joined #openstack-infra | 12:50 | |
| jeblair | hashar: yeah, that's the trick... | 12:50 |
| maxired | The returned error is {"jsonrpc":"2.0","id":5,"error":{"code":-32603,"message":"Cannot store contact information"}} | 12:50 |
| maxired | Does anybody know what goes wrong ? | 12:51 |
| *** dkliban_afk is now known as dkliban | 12:51 | |
| hashar | jeblair: a thing I don't understand is why the queue processing is blocked is the event reporting blocking? | 12:53 |
| hashar | jeblair: and potentially you could tcpkill the stuck connections. That will cause the reporting events to be lost or report some error back to gerrit but might free up the other events | 12:53 |
| jeblair | hashar: the event report happens in the main thread | 12:53 |
| *** nosnos has quit IRC | 12:53 | |
| jeblair | hashar: yeah, was just thinking about whether i could kill the conn | 12:53 |
| hashar | https://en.wikipedia.org/wiki/Tcpkill :-] | 12:54 |
| hashar | I am a noob | 12:54 |
| *** jgallard has joined #openstack-infra | 12:54 | |
| *** prad_ has joined #openstack-infra | 12:55 | |
| *** maxired_ has joined #openstack-infra | 12:55 | |
| *** zehicle_at_dell has joined #openstack-infra | 12:55 | |
| sdague | ttx: is there a specific etherpad you have an issue with? | 12:56 |
| ttx | sdague: looks like a firefox issue. Chromium loads page well enough apparently | 12:57 |
| hashar | jeblair: or maybe restarting Gerrit will free the TCP connections. | 12:58 |
| *** maxired has quit IRC | 12:58 | |
| jeblair | hashar: that might be the easier way; there are problems with using tcpkill, and it looks like killcx doesn't support ipv6 | 12:58 |
| maxired_ | help | 12:59 |
| jeblair | i'll try restarting gerrit now | 12:59 |
| * hashar crosses fingers for the 212 pending results | 12:59 | |
| sdague | ttx: so, honestly, I expect that firefox's enforcement of revocation lists is going to mean it's slow on a lot of things now | 13:00 |
| jeblair | #status alert Zuul is stuck due to earlier networking issues with Gerrit server, work in progress. | 13:00 |
| openstackstatus | jeblair: sending alert | 13:00 |
| hashar | result are being dequeued | 13:01 |
| -openstackstatus- NOTICE: Zuul is stuck due to earlier networking issues with Gerrit server, work in progress. | 13:02 | |
| *** ChanServ changes topic to "Zuul is stuck due to earlier networking issues with Gerrit server, work in progress." | 13:02 | |
| hashar | I guess the Zuul gerrit reporter does not retry on ssh communications errors :/ | 13:02 |
| fungi | what, zuul troubles? | 13:03 |
| hashar | fungi: see openstack-infra list. It got stuck communicating with Gerrit | 13:03 |
| fungi | looks like it must have stopped taking on new jobs shortly after i fell asleep | 13:03 |
| jeblair | fungi, clarkb, sdague: gerrit had errors connecting to its trove db. this caused zuul to get stuck trying to report a change. | 13:04 |
| openstackstatus | jeblair: finished sending alert | 13:04 |
| fungi | well that's no good at all | 13:04 |
| *** aysyd has quit IRC | 13:04 | |
| fungi | i see you just loaded the queues | 13:04 |
| jeblair | i've restarted gerrit which seems to have unstuck the connection | 13:05 |
| hashar | jeblair: potentially you could grep the logs to replay the lost events but it is probably safer to let folks retrigger them | 13:05 |
| jeblair | fungi: no, that's the queued events that zuul hadn't processed | 13:05 |
| fungi | ahh | 13:05 |
| fungi | right, i missed the queue length up at the top | 13:05 |
| jeblair | what i should have done is saved the queues before restarting gerrit; what was running is lost | 13:05 |
| jeblair | so, lesson learned for next time | 13:05 |
| hashar | but you had jobs being run so I am not sure how you could have saved the queue | 13:06 |
| fungi | oh, jobs had completed but not reported, and that's what was lost with the gerrit restart? | 13:06 |
| jeblair | hashar: we have a script to save things that are in the pipelines | 13:06 |
| jeblair | fungi: yep | 13:06 |
| jeblair | hashar: it's only the event queue that we can't save externally | 13:07 |
| *** julim has joined #openstack-infra | 13:08 | |
| jeblair | #status ok Zuul is processing changes now; some results were lost. Use "recheck bug 1317089" if needed. | 13:09 |
| openstackstatus | jeblair: sending ok | 13:09 |
| uvirtbot | Launchpad bug 1317089 in openstack-ci "Zuul lost jobs due to Gerrit database error on 2014-05-07" [Undecided,New] https://launchpad.net/bugs/1317089 | 13:09 |
| fungi | looking at the cacti graphs, there's a brief spike in established tcp connections at the time zuul activity started to plummet | 13:09 |
| fungi | established tcp connections on review.o.o | 13:09 |
| fungi | also cache memory in use on gerrit jumped up a few gigs to a new plateau at the same moment | 13:10 |
| *** ChanServ changes topic to "Gerrit upgraded to 2.8. See: https://wiki.openstack.org/wiki/GerritUpgrade" | 13:11 | |
| -openstackstatus- NOTICE: Zuul is processing changes now; some results were lost. Use "recheck bug 1317089" if needed. | 13:11 | |
| jeblair | fungi: and note the eth1 drop | 13:11 |
| fungi | yeah | 13:11 |
| *** wenlock has joined #openstack-infra | 13:12 | |
| jeblair | hopefully this won't be a regular occurence, but i think we can reproduce in a test env and see if we can make zuul more resilient | 13:12 |
| jeblair | fungi: i'm going to go back to being afk now | 13:12 |
| openstackstatus | jeblair: finished sending ok | 13:12 |
| jeblair | hashar: thanks for your help! | 13:13 |
| fungi | reproducing does seem probably fairly easy with review-dev and zuul-dev or something | 13:13 |
| *** smarcet has joined #openstack-infra | 13:13 | |
| fungi | jeblair: hashar: thanks! | 13:13 |
| hashar | jeblair: i feel sorry the result queue got lost :-( | 13:13 |
| *** dkranz has joined #openstack-infra | 13:13 | |
| fungi | hashar: it's not even remotely the first time we've lost queued results | 13:13 |
| hashar | hopefully devs will figure it out and recheck accoridngly | 13:13 |
| jeblair | hashar: me too. but we know how to deal with it better next time, at least. | 13:13 |
| *** eharney has joined #openstack-infra | 13:14 | |
| hashar | would it make sense to have the event report to be outside of the main thread so they are not blocking? | 13:14 |
| fungi | hashar: probably would be good to open a zuul-specific bug to track the underlying problem (separate from the outage event) and we can record some ideas in there | 13:15 |
| fungi | so far status.rackspace.com only mentions disruptions today for block storage in the region where we're running gerrit | 13:17 |
| *** signed8bit has joined #openstack-infra | 13:18 | |
| *** e0ne has quit IRC | 13:19 | |
| *** e0ne has joined #openstack-infra | 13:20 | |
| *** zns has joined #openstack-infra | 13:20 | |
| *** mriedem has joined #openstack-infra | 13:20 | |
| *** timrc-afk is now known as timrc | 13:21 | |
| fungi | the drop in eth1 traffic on review.o.o seems to have started somewhere between the 07:35 and 07:40 snmp polls | 13:21 |
| *** zul has joined #openstack-infra | 13:22 | |
| *** e0ne has quit IRC | 13:22 | |
| *** e0ne has joined #openstack-infra | 13:22 | |
| *** Hal_ has quit IRC | 13:22 | |
| *** e0ne has quit IRC | 13:23 | |
| hashar | UTC ? | 13:23 |
| *** cody-somerville has quit IRC | 13:23 | |
| *** doug-fish has joined #openstack-infra | 13:23 | |
| *** e0ne has joined #openstack-infra | 13:23 | |
| hashar | someone reported on this channel at 5:40am UTC that reviewDB was unreacheable | 13:23 |
| *** Hal has joined #openstack-infra | 13:23 | |
| hashar | (the Gerrit web interface reported that apparently) | 13:23 |
| *** Hal is now known as Guest86200 | 13:24 | |
| *** Guest86200 has quit IRC | 13:24 | |
| *** Hal_ has joined #openstack-infra | 13:25 | |
| fungi | interesting. judging from the drop in the second sample it looks like gerrit stopped receiving data from the db at roughly 07:38:05 and then started to get responses again at 07:44:45 | 13:26 |
| *** e0ne has quit IRC | 13:26 | |
| fungi | maybe there was more than one event | 13:26 |
| fungi | digging deeper | 13:26 |
| fungi | hashar: the first mention in see in this channel is "07:37 SpamapS ruh roh" which correlates pretty closely to the graph | 13:28 |
| fungi | (utc) | 13:28 |
| *** dstanek_zzz has joined #openstack-infra | 13:29 | |
| *** dstanek_zzz is now known as dstanek | 13:29 | |
| *** dstanek has quit IRC | 13:29 | |
| *** ominakov has joined #openstack-infra | 13:29 | |
| *** dstanek has joined #openstack-infra | 13:29 | |
| *** dizquierdo has quit IRC | 13:31 | |
| fungi | the gerrit error_log for today is gigantic | 13:32 |
| *** mestery has quit IRC | 13:33 | |
| *** zz_gondoi is now known as gondoi | 13:33 | |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/zuul: Expose management_event_queue length in status.json https://review.openstack.org/92582 | 13:33 |
| *** matsuhashi has quit IRC | 13:35 | |
| *** gondoi is now known as zz_gondoi | 13:35 | |
| *** zul has quit IRC | 13:36 | |
| *** zul has joined #openstack-infra | 13:36 | |
| fungi | also, my math was off. adjusted estimate based on sample drop is that it started at 07:36:55 | 13:36 |
| *** alexpilotti has joined #openstack-infra | 13:37 | |
| fungi | though the first sign of anything awry in gerrit's error_log is... | 13:38 |
| fungi | [2014-05-07 05:40:39,508] ERROR com.google.gerrit.server.events.EventFactory : Error while getting full commit message for change 92448 | 13:38 |
| fungi | [2014-05-07 05:40:39,508] ERROR com.google.gerrit.server.query.change.QueryProcessor : Cannot execute query: 92448 | 13:38 |
| *** gokrokve has joined #openstack-infra | 13:38 | |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/zuul: Drop formatStatusHTML() methods https://review.openstack.org/92585 | 13:39 |
| *** jlibosva has quit IRC | 13:39 | |
| *** mengxd has joined #openstack-infra | 13:39 | |
| *** miqui has quit IRC | 13:39 | |
| *** miqui has joined #openstack-infra | 13:39 | |
| *** sdake_ has quit IRC | 13:40 | |
| *** dprince has joined #openstack-infra | 13:40 | |
| *** WaltNik2 has joined #openstack-infra | 13:40 | |
| hashar | fungi: that might have killed Gerrit somehow | 13:40 |
| hashar | fungi: or Gerrit could not retrieve the commit message because the DB died at that time | 13:41 |
| *** thomasem has joined #openstack-infra | 13:41 | |
| *** krtaylor_ has joined #openstack-infra | 13:41 | |
| fungi | yeah, i'm thinking gerrit started trying to query for that around the time the outage began and waited ~4 minutes for a response from the database | 13:41 |
| *** krtaylor_ has quit IRC | 13:42 | |
| fungi | and then logged that when it finally gave up | 13:42 |
| *** krtaylor has quit IRC | 13:42 | |
| *** lcostantino has quit IRC | 13:42 | |
| fungi | i'm opening a support case with rackspace to see if they have any additional information on something happening in that region with those services around that timeframe | 13:42 |
| *** gokrokve has quit IRC | 13:43 | |
| *** WaltNik has quit IRC | 13:43 | |
| *** liam_ has joined #openstack-infra | 13:45 | |
| *** liam_ is now known as Guest5040 | 13:45 | |
| *** freyes has joined #openstack-infra | 13:46 | |
| *** sandywalsh has joined #openstack-infra | 13:48 | |
| *** adalbas has quit IRC | 13:50 | |
| *** Guest5040 has quit IRC | 13:51 | |
| fungi | rackspace Ticket ID | 13:51 |
| fungi | 140507-00805-3 | 13:51 |
| *** krtaylor has joined #openstack-infra | 13:52 | |
| fungi | (in case anyone within rackspace wants to follow along) | 13:52 |
| *** mwagner_ has joined #openstack-infra | 13:54 | |
| *** cody-somerville has joined #openstack-infra | 13:55 | |
| *** cody-somerville has quit IRC | 13:55 | |
| *** cody-somerville has joined #openstack-infra | 13:55 | |
| hashar | fungi: the DB event occurred at 5:40 but the cacti network drop is at 7:40 seems there is some timezone inconsitency | 13:57 |
| *** skolekonov has quit IRC | 13:59 | |
| fungi | hashar: oh, huh. yeah i missed that | 14:00 |
| fungi | that was the earliest database query error, but maybe it was only transient | 14:01 |
| YorikSar | Hello, all. Does Zuul merge changes before putting them to the queue or only when jobs are run? | 14:01 |
| fungi | YorikSar: i don't understand your question | 14:02 |
| *** aysyd has joined #openstack-infra | 14:02 | |
| fungi | YorikSar: in an independent pipeline zuul merges changes to the tip of the target branch and provides those references to jobs. in a dependent queue zuul merges changes with each other in the order in which they entered the queue, or to the target branch if there's no change ahead for the same project+branch, and then provides those references to the jobs which are run | 14:04 |
| *** gokrokve has joined #openstack-infra | 14:04 | |
| YorikSar | fungi: I got "couldn't merge" from 3rd-party CI while Zuul just added change to the long queue. So I wonder if I can expect Zuul to say "Can't merge" when it's going to run jobs or my change merged OK and that 3rd-party CI is broken. | 14:05 |
| *** sandywalsh has quit IRC | 14:05 | |
| *** markmcclain has joined #openstack-infra | 14:05 | |
| phschwartz | morning infra | 14:05 |
| *** sandywalsh has joined #openstack-infra | 14:05 | |
| fungi | YorikSar: which change? the zuul status page will show if it's having trouble merging your change on top of the other changes ahead of it | 14:05 |
| fungi | phschwartz: you may be interested in ticket 140507-00805-3 | 14:05 |
| YorikSar | fungi: https://review.openstack.org/#/c/84667/ | 14:06 |
| *** dpyzhov has left #openstack-infra | 14:06 | |
| phschwartz | fungi: not seeing it, mind providing a url | 14:06 |
| YorikSar | NEC OpenStack CI said it couldn't merge it with current HEAD. | 14:06 |
| fungi | phschwartz: https://mycloud.rackspace.com/cloud/610275/tickets#140507-00805-3 | 14:07 |
| fungi | YorikSar: their local repository clone might be broken in some way, which can make zuul think no changes are able to merge | 14:07 |
| phschwartz | fungi: looking | 14:08 |
| YorikSar | fungi: Ok, the first job started. Looks like it's NEC's fault. | 14:08 |
| YorikSar | fungi: Yeah. Thanks. | 14:08 |
| *** markmcclain1 has joined #openstack-infra | 14:08 | |
| *** Longgeek has quit IRC | 14:08 | |
| fungi | hashar: so it seems we had multiple query errors actually, at 05:40:39, 05:54:05 and 07:36:32 (that last one corresponds closely to the apparent network outage and subsequent zuul misbehavior) | 14:09 |
| *** markmcclain has quit IRC | 14:10 | |
| therve | Hi all | 14:10 |
| fungi | hashar: we've additionally seen one more at 12:45:22 (shortly after the gerrit restart) | 14:10 |
| *** aysyd has quit IRC | 14:11 | |
| fungi | so these might be a semi-regular occurrence | 14:11 |
| hashar | fungi: a 1 minute aggregate of jobs launched over the last 7 hours : http://tinyurl.com/kx7n3ve | 14:11 |
| fungi | checking earlier logs to confirm | 14:11 |
| therve | The heat-templates job seems to be working fine, but I'd like to remove some services from devstack gate to make it more lean | 14:11 |
| *** aysyd has joined #openstack-infra | 14:12 | |
| therve | Is http://paste.openstack.org/show/79393/ reasonable? | 14:12 |
| hashar | fungi: we could use a gauge of the number of jobs being run. Maybe gearman as such metric | 14:12 |
| hashar | fungi: s/we/you/ | 14:12 |
| fungi | hashar: use for what? | 14:12 |
| phschwartz | fungi: hmm, not seeing a ticket with that id associated to the account. Let me sudo to it and see. | 14:13 |
| *** mrodden has quit IRC | 14:13 | |
| *** locke105 has quit IRC | 14:13 | |
| *** sdake_ has joined #openstack-infra | 14:13 | |
| *** sdake_ has quit IRC | 14:13 | |
| *** sdake_ has joined #openstack-infra | 14:13 | |
| phschwartz | hmm, still not seeing it | 14:13 |
| fungi | phschwartz: opened by openstackci roughly 20 minutes ago | 14:14 |
| fungi | still in new status at the moment | 14:14 |
| *** bnemec has quit IRC | 14:15 | |
| phschwartz | Fungi: Is it titled "Loss of connectivity"? | 14:15 |
| fungi | phschwartz: yep | 14:15 |
| *** bnemec has joined #openstack-infra | 14:15 | |
| phschwartz | Interesting. Seeing it with a completely different ticket id | 14:15 |
| fungi | yeah, shows me 140507-00805-3 in the open tickets list, the ticket details and the url | 14:16 |
| *** locke105 has joined #openstack-infra | 14:16 | |
| phschwartz | fungi: weird. I found it, all that matters. I am going to see if we can have anyone look at it noe | 14:16 |
| phschwartz | *now | 14:16 |
| *** manishg has joined #openstack-infra | 14:17 | |
| *** thedodd has joined #openstack-infra | 14:17 | |
| fungi | phschwartz: cool--thanks! whatever it was, it was sort of disruptive. i'm not 100% certain it was an issue on the hosting end (there's always the possibility of a kernel or userspace problem in our server instance), but so far i'm finding no evidence of any | 14:17 |
| *** mrodden has joined #openstack-infra | 14:18 | |
| *** yaguang has joined #openstack-infra | 14:18 | |
| phschwartz | fungi: I agree that looking at the lowest layer and working up is the right course. It should hopefully give us more info | 14:18 |
| *** esker has joined #openstack-infra | 14:21 | |
| *** manishg has quit IRC | 14:22 | |
| *** manishg_ has joined #openstack-infra | 14:22 | |
| openstackgerrit | Thomas Herve proposed a change to openstack-infra/devstack-gate: Add a dedicated config for heat-templates https://review.openstack.org/92592 | 14:22 |
| openstackgerrit | Thomas Herve proposed a change to openstack-infra/config: Use the new config for heat-templates https://review.openstack.org/92594 | 14:24 |
| *** dims has joined #openstack-infra | 14:25 | |
| *** matrohon has quit IRC | 14:27 | |
| *** manishg has joined #openstack-infra | 14:27 | |
| *** manishg_ has quit IRC | 14:27 | |
| fungi | hashar: i found a better fingerprint in the gerrit error_log (i really hate their log format), which shows the first instance of gerrit complaining "Cannot open ReviewDb" at 07:36:34 and continuing through 07:47:18. i find no prior incidents for that going to back before we put it into production | 14:30 |
| fungi | and the reason the orm layer claims for it is "Communications link failure" | 14:31 |
| *** manishg has quit IRC | 14:31 | |
| cody-somerville | Hey. So if I add stanza to make a job non-voting for a branch regex, it stops running the job for everything else. Do I add another stanza for the same job but no branch argument? Or do I need to do something completely different? | 14:32 |
| fungi | so gerrit seems to be pretty certain the database was unreachable over the network for more than 10 minutes | 14:32 |
| *** manishg has joined #openstack-infra | 14:32 | |
| fungi | cody-somerville: the "voting" parameter is applied to all runs of that job name. the "branch" parameter is used to indicate on which branches the job should be run | 14:33 |
| *** zul has quit IRC | 14:33 | |
| fungi | cody-somerville: zuul currently lacks a construct for "voting on some branches, run but non-voting on other branches" and the usual workaround for that is to use two jobs | 14:33 |
| *** jamespage_ has joined #openstack-infra | 14:33 | |
| sdague | cody-somerville: voting isn't a tri-state variable | 14:34 |
| *** rlandy_ has joined #openstack-infra | 14:34 | |
| *** zehicle_at_dell has quit IRC | 14:34 | |
| fungi | cody-somerville: you'll see some examples (for example ironic does this) of overloading a {branch-selector} parameter to a job template to make a -nv (non-voting) version of a job which can be set voting:no by name that way | 14:34 |
| sdague | I do think it would be a good enhancement to let voting be layered so you could make a job non voting under certain match conditions | 14:35 |
| sdague | but zuul can't do that today | 14:35 |
| fungi | sdague: agreed. it's just that nobody's written it yet | 14:35 |
| *** jamespage_ has quit IRC | 14:35 | |
| sdague | yep | 14:35 |
| fungi | but definitely seems a reasonable featurte | 14:35 |
| fungi | feature | 14:35 |
| phschwartz | sdague: That is actually a great idea. I wish I had enough free time to do it. Maybe I will get lucky and get some time. | 14:36 |
| fungi | similarly, you can't make one job name voting on some projects and run but non-voting on other projects | 14:37 |
| *** manishg has quit IRC | 14:37 | |
| *** manishg has joined #openstack-infra | 14:37 | |
| *** zul has joined #openstack-infra | 14:37 | |
| sdague | phschwartz: that would be awesome | 14:37 |
| *** zul has quit IRC | 14:37 | |
| fungi | i would envision a more robust voting selector which could take branch and project pattern lists | 14:37 |
| *** rlandy has quit IRC | 14:37 | |
| fungi | but there are likely many ways to skin that | 14:37 |
| *** esker has quit IRC | 14:38 | |
| *** thomasem has quit IRC | 14:38 | |
| *** zz_gondoi is now known as gondoi | 14:38 | |
| *** zul has joined #openstack-infra | 14:38 | |
| *** thomasem has joined #openstack-infra | 14:39 | |
| *** manishg has quit IRC | 14:42 | |
| *** manishg has joined #openstack-infra | 14:42 | |
| * anteaya notes that so far her parent's laggy wifi is working | 14:47 | |
| *** manishg has quit IRC | 14:47 | |
| *** manishg_ has joined #openstack-infra | 14:47 | |
| *** etoews has joined #openstack-infra | 14:48 | |
| *** wenlock has quit IRC | 14:49 | |
| *** changbl has quit IRC | 14:49 | |
| *** geertj has joined #openstack-infra | 14:51 | |
| anteaya | I'm going to try to shop this patch around today, it is a publishing job for the infra-manual repo: https://review.openstack.org/#/c/89421/ | 14:51 |
| *** manishg_ has quit IRC | 14:51 | |
| *** unicell1 has quit IRC | 14:52 | |
| *** sdake_ has quit IRC | 14:55 | |
| *** unicell has joined #openstack-infra | 14:55 | |
| *** manishg has joined #openstack-infra | 14:56 | |
| *** zehicle_at_dell has joined #openstack-infra | 14:58 | |
| *** oomichi has quit IRC | 14:59 | |
| *** dizquierdo has joined #openstack-infra | 14:59 | |
| *** manishg has quit IRC | 15:00 | |
| *** manishg has joined #openstack-infra | 15:01 | |
| cody-somerville | fungi: But that nv job is ran in addition to the job I want to be notvoting for certain branches | 15:01 |
| cody-somerville | fungi: am I understanding that right? | 15:01 |
| *** yfried has quit IRC | 15:03 | |
| *** afazekas has quit IRC | 15:05 | |
| mordred | morning all | 15:05 |
| cody-somerville | So I guess I need to make the regex inverse to make it run against all the other jobs | 15:05 |
| *** manishg has quit IRC | 15:05 | |
| cody-somerville | then create special nonvoting job that only runs on the branches I want the job to be notvoting | 15:05 |
| *** manishg has joined #openstack-infra | 15:06 | |
| anteaya | morning mordred | 15:06 |
| mordred | anteaya: how are things? | 15:06 |
| fungi | cody-somerville: rght | 15:06 |
| fungi | right | 15:06 |
| fungi | cody-somerville: so for example you can have one job voting and only run on master, another non-voting and run on all branches which aren't master | 15:07 |
| *** sdake_ has joined #openstack-infra | 15:07 | |
| fungi | there should be plenty of negative-lookahead expression examples in the file already | 15:09 |
| fungi | mordred: i'm finally finding a moment to correct the lp api key used by jeepyb... how/where in lp where you regenerating that? | 15:10 |
| *** manishg has quit IRC | 15:10 | |
| *** manishg has joined #openstack-infra | 15:10 | |
| mordred | fungi: I don't think I was the one who re-did any of the lp keys | 15:12 |
| mordred | fungi: or if I was, I do not remember how I did it :( | 15:12 |
| mordred | fungi: OH | 15:12 |
| mordred | no, I remember how | 15:12 |
| mordred | :) | 15:12 |
| fungi | mordred: oh! okay, though clarkb had blamed you ;) i found the commit in hiera from where you updated it, just poking around in lp now to see how it's regenerated or looked up | 15:12 |
| *** gondoi is now known as zz_gondoi | 15:13 | |
| mordred | fungi: the process is in the etherpad we were using - but what you essentially have to do is run a launchpadlib program (such as jeepyb) as a user with no current lp creds | 15:13 |
| fungi | is it done through an api call, or via the web interface? | 15:13 |
| fungi | via api. got it | 15:13 |
| mordred | that will open up lynx for you to the oath page | 15:13 |
| fungi | thanks! | 15:13 |
| mordred | and then you'll log in as the user in question, and it will generate a launchpadlib token in .launchpadlib | 15:14 |
| mordred | it would be eversogreat if there was less magic | 15:14 |
| fungi | cool. i've actually done that before, just didn't realize it was a different token each time | 15:14 |
| *** manishg has quit IRC | 15:15 | |
| *** david-lyle has joined #openstack-infra | 15:15 | |
| *** manishg has joined #openstack-infra | 15:15 | |
| *** sandywalsh has quit IRC | 15:17 | |
| *** afazekas has joined #openstack-infra | 15:18 | |
| anteaya | mordred: I'm holding onto the hope I can be back in my house after summit, and my cat is 5 feet away from me so I am glad she is here | 15:18 |
| anteaya | mordred: also I'm shopping for reviews on https://review.openstack.org/#/c/89421/ | 15:19 |
| *** manishg has quit IRC | 15:20 | |
| *** jcoufal has quit IRC | 15:20 | |
| *** manishg has joined #openstack-infra | 15:20 | |
| *** yaguang has quit IRC | 15:23 | |
| *** _nadya_ has joined #openstack-infra | 15:23 | |
| *** ihrachyshka has quit IRC | 15:24 | |
| anteaya | maxired_: you didn't do anything wrong there was an issue with our db connection when you input your data into gerrit, try again | 15:24 |
| *** manishg has quit IRC | 15:25 | |
| *** manishg has joined #openstack-infra | 15:25 | |
| *** atiwari has joined #openstack-infra | 15:25 | |
| mordred | anteaya: any reason we're not also running the check job in the gate pipeline? (the patch looks good - just wondering about context on that choice I might be missing) | 15:26 |
| anteaya | noone had asked me that question before | 15:26 |
| anteaya | the check job is mostly to publish a set of the docs for evaluation, the way I understand it | 15:27 |
| anteaya | I don't see the harm in doing that in the gate pipeline as well | 15:27 |
| anteaya | would you like that to happen in the gate as well, mordred? | 15:28 |
| *** kgriffs|afk is now known as kgriffs | 15:28 | |
| openstackgerrit | Marton Kiss proposed a change to openstack-infra/config: Create groups-static-pages project https://review.openstack.org/89734 | 15:28 |
| *** james_li has joined #openstack-infra | 15:28 | |
| *** ominakov has quit IRC | 15:28 | |
| *** manishg has quit IRC | 15:29 | |
| *** manishg has joined #openstack-infra | 15:30 | |
| *** ildikov has joined #openstack-infra | 15:30 | |
| *** zehicle_at_dell has quit IRC | 15:31 | |
| *** dkranz has quit IRC | 15:31 | |
| *** mrmartin has joined #openstack-infra | 15:31 | |
| *** james_li has quit IRC | 15:33 | |
| anteaya | YorikSar: I don't think that 3rd party CI systems should be posting this message to our patches: This change was unable to be automatically merged with the current state of the repository. Please rebase your change and upload a new patchset. | 15:34 |
| *** manishg has quit IRC | 15:34 | |
| *** wenlock has joined #openstack-infra | 15:34 | |
| anteaya | I think that they should say build succeeded or build failed and provide logs | 15:34 |
| *** manishg has joined #openstack-infra | 15:35 | |
| *** zehicle_at_dell has joined #openstack-infra | 15:35 | |
| mordred | anteaya: hrm. they may not have much choice if they're using zuul to run their stuff | 15:35 |
| mordred | like, if they're running their own zuul | 15:35 |
| *** zehicle_at_dell has quit IRC | 15:35 | |
| mordred | that's just a thing zuul does | 15:35 |
| *** ominakov has joined #openstack-infra | 15:35 | |
| *** zehicle_at_dell has joined #openstack-infra | 15:35 | |
| anteaya | hmmmmmm | 15:35 |
| mordred | anteaya: I don't think we need to do it in the gate for draft publication purposes, no. that's a good point | 15:36 |
| anteaya | perhaps this is an item for the 3rd party summit session | 15:36 |
| *** yaguang has joined #openstack-infra | 15:36 | |
| anteaya | mordred: okay thanks | 15:36 |
| openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: Create an oslo-specs repository https://review.openstack.org/92614 | 15:38 |
| *** dizquierdo has quit IRC | 15:38 | |
| fungi | heyhey! update_bug.py is working again Shrews! see the bottom of bug 1248794 for an example of it reassigning one | 15:39 |
| uvirtbot | Launchpad bug 1248794 in openstack-ci "Allow core reviewers restore auto-abandoned reviews" [Medium,In progress] https://launchpad.net/bugs/1248794 | 15:39 |
| *** zehicle_at_dell has quit IRC | 15:39 | |
| fungi | (authenticating as the right account makes all the difference) | 15:39 |
| *** zehicle_at_dell has joined #openstack-infra | 15:39 | |
| *** manishg has quit IRC | 15:39 | |
| *** manishg has joined #openstack-infra | 15:39 | |
| *** gyee has joined #openstack-infra | 15:40 | |
| anteaya | dhellmann: do you want changes in olso-specs reported to the olso channel? | 15:40 |
| dhellmann | anteaya: ah, yeah, that would be good, thanks for noticing that | 15:41 |
| *** jasondotstar has joined #openstack-infra | 15:41 | |
| *** reed has joined #openstack-infra | 15:41 | |
| *** esker has joined #openstack-infra | 15:42 | |
| dhellmann | anteaya: and that's a step I've left out of my instructions in https://wiki.openstack.org/wiki/Oslo/CreatingANewLibrary too, so double thanks | 15:43 |
| anteaya | np | 15:43 |
| openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: Create an oslo-specs repository https://review.openstack.org/92614 | 15:43 |
| mordred | fungi: did we ever land the change to fix the local-db->remote-db issue for jeepyb things? | 15:43 |
| *** manishg has quit IRC | 15:44 | |
| *** sdake_ has quit IRC | 15:44 | |
| *** manishg has joined #openstack-infra | 15:44 | |
| *** dkranz has joined #openstack-infra | 15:45 | |
| fungi | mordred: er, i think we fixed a biting instance of it, but there are still a handful of direct uses of mysqldb which don't specify a host (and should ideally be corrected to use jeepyb.gerritdb instead since it's already fixed in that module) | 15:45 |
| *** zns has quit IRC | 15:45 | |
| Shrews | fungi: awesome! | 15:45 |
| *** afazekas has quit IRC | 15:45 | |
| mrmartin | anteaya: hi, could you review this: https://review.openstack.org/#/c/89734/4 ? it could be great to push this through | 15:47 |
| anteaya | mrmartin: I will click | 15:47 |
| mrmartin | thnx | 15:47 |
| openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: add gerritbot configs for new oslo libs https://review.openstack.org/92617 | 15:48 |
| clarkb | fungi: mordred: also did we merge the DB backup change for review.o.o? | 15:48 |
| anteaya | mrmartin: help me understand why this repo is necessary | 15:48 |
| dhellmann | anteaya: ^^ | 15:49 |
| clarkb | and good to know I remembered the lp cred change was a mordred change :) | 15:49 |
| anteaya | mrmartin: as opposed to say wiki pages for this content | 15:49 |
| *** manishg has quit IRC | 15:49 | |
| *** manishg has joined #openstack-infra | 15:49 | |
| mrmartin | anteaya: the static pages will be held here for community portal in markdown format, so publishing content can go through a standard review process | 15:49 |
| mordred | clarkb: I don't know - looking | 15:50 |
| mrmartin | anteaya: check to source repo: https://github.com/mkissam/groups-static-pages | 15:50 |
| dhellmann | anteaya: the next time we have an opportunity to get an intern, we should build some sort of tool to make adding new projects to all of these infra config files simpler. maybe an interactive thing of some sort, to at least make the initial edits. | 15:50 |
| *** Sukhdev has joined #openstack-infra | 15:50 | |
| mordred | clarkb: no | 15:51 |
| mordred | fungi: https://review.openstack.org/#/c/91876/ | 15:51 |
| clarkb | dhellmann: anteaya: I am actually not fond of that idea for one big reason. We get a lot of people wanting to be part of the infra via stackforge or whatever and they have never used gerrit before | 15:51 |
| clarkb | dhellmann: anteaya: forcing them through the initial process is a really good "Do you really want this?" | 15:51 |
| anteaya | dhellmann: that sounds like a great idea | 15:52 |
| clarkb | wouldn't think that would be a problem but it is. We have even had people write wiki docs on how to contribute to stackforge projects that say use a github PR | 15:52 |
| mordred | clarkb: that's a valid POV - but I will admit that I also want dhellman's thing | 15:52 |
| dhellmann | clarkb: I'm thinking a script someone could run locally to make edits to a copy of openstack-infra/config they have checked out. They would still have to submit the changes, etc. | 15:52 |
| anteaya | dhellmann: not sure when I would have the energy to be a point mentor again, but I sure would do what I can to play a supportive role | 15:52 |
| mordred | but that's because I want there to eventually be an instance of infra somewhere that is a public github competitor :) | 15:52 |
| dhellmann | clarkb: I'm thinking of automating parts of https://wiki.openstack.org/wiki/Oslo/CreatingANewLibrary#Importing_the_Repository_into_the_CI_System | 15:52 |
| *** Hal_ has quit IRC | 15:53 | |
| sdague | dhellmann: how would that impact the project creators knowledge in changing jobs later? | 15:53 |
| clarkb | mordred: right so I think if we can simplify the actual bits that need flipping ++ to that | 15:53 |
| dhellmann | anteaya: ditto, I was hoping you'd take it and run :-) | 15:53 |
| clarkb | but don't remove the person from making the change | 15:53 |
| sdague | I do think the learning is important | 15:53 |
| dhellmann | sdague: there's learning, and there's "you've missed a small change in one of a zillion places" | 15:53 |
| *** manishg has quit IRC | 15:53 | |
| anteaya | dhellmann: too busy running away from my home atm | 15:54 |
| anteaya | one fleeing at a time | 15:54 |
| dhellmann | anteaya: I know a circus you could join. | 15:54 |
| *** arnaud has joined #openstack-infra | 15:54 | |
| *** manishg has joined #openstack-infra | 15:54 | |
| anteaya | dhellmann: if I can jump up and down, I'm in | 15:54 |
| anteaya | and bring my cat | 15:54 |
| dhellmann | anteaya: :-) | 15:54 |
| anteaya | :D | 15:54 |
| *** Hal has joined #openstack-infra | 15:55 | |
| *** Hal is now known as Guest74737 | 15:55 | |
| anteaya | anyone else wanting to weigh in on whether we need a repo for mrmartin's static pages: https://github.com/mkissam/groups-static-pages | 15:55 |
| *** sdake_ has joined #openstack-infra | 15:56 | |
| anteaya | I'm leaning wikipages here | 15:56 |
| anteaya | is there a good argument for this repo i don't know about yet? | 15:56 |
| *** pcrews has joined #openstack-infra | 15:56 | |
| clarkb | anteaya: it looks similar to maybe some of our in repo docs? | 15:56 |
| mrmartin | anteaya: I want to launch to groups portal, and it is the easiest way to allow content edit for 3rd party until we don't have a working openid auth. | 15:57 |
| anteaya | it does, yes | 15:57 |
| clarkb | looks like this is content for the actual site | 15:57 |
| *** zehicle_at_dell has quit IRC | 15:57 | |
| anteaya | mrmartin: so is this to be a long lived repo or a stop over until you have something better? | 15:57 |
| clarkb | I think its ok to have it in a new repo is if the intent for the other groups repo is that anyone could overlay their own stuff on top like this | 15:58 |
| *** manishg has quit IRC | 15:58 | |
| mrmartin | anteaya: just a temporary solution, until we don't have a working productive authentication system, but it can take several months | 15:58 |
| *** manishg has joined #openstack-infra | 15:59 | |
| anteaya | the problem is then we are left with a repo that noone wants and then we have to figure out what to do with it | 16:00 |
| anteaya | mrmartin: what is the long term vision, perhaps there is a better way to meet your goals? | 16:00 |
| mrmartin | anteaya: http://summit.openstack.org/cfp/details/257 | 16:00 |
| fungi | well, we at least have a workflow for moving disused projects into an attic namespace now | 16:00 |
| mrmartin | anteaya: the cms site is ready, I just need to bring the ci side into sync | 16:01 |
| *** hashar has quit IRC | 16:01 | |
| anteaya | this is a sandbox repo for your openid work? | 16:01 |
| *** hemna_ is now known as hemna | 16:03 | |
| *** _nadya_ has quit IRC | 16:03 | |
| mordred | dhellmann, clarkb, sdague: also, I think we have enough activity and enough boiler plate that forcing people to go through a learning experience just to learn something if it could be easily simplified, while I agree with the sentiment, may be counter productive | 16:03 |
| *** chandan_kumar has quit IRC | 16:03 | |
| mordred | considering that _We_ have to review the damned changes | 16:03 |
| *** manishg has quit IRC | 16:03 | |
| clarkb | mordred: yup the boilerplate should definitely be killed | 16:03 |
| *** manishg has joined #openstack-infra | 16:04 | |
| clarkb | mordred: any maybe we have bigger warnings about gerrit if we go down the path of reviewless project creation | 16:04 |
| mrmartin | anteaya: no, openid is a different project, but the user group portal most use a centralized authentication, and we plan to use openid project for that | 16:04 |
| mordred | clarkb: funny story is - docs folks want a TTW editing solution... | 16:04 |
| *** lcheng_ has joined #openstack-infra | 16:04 | |
| mordred | clarkb: so one could imagine a web tool that generates a change and then loads it into the TTW editor | 16:04 |
| *** freyes has quit IRC | 16:04 | |
| dhellmann | clarkb: I'm happy to have project creation reviewed, I just want the setup simplified a bit. Making a tool to start the edits seems simpler than changing all the tools using the files we have in place now. | 16:05 |
| mordred | allowing a person to edit or submit from that point - and/or a command line tool like the cookiecutter that can do it for experts like dhellmann | 16:05 |
| *** maxired_ has quit IRC | 16:05 | |
| mordred | dhellmann: yeah, I think step one is just "sudo make-me-a-project" that appropriately adds a basic project to all of the right files - maybe the tool should either ask 4 questions or have some command line options | 16:06 |
| mrmartin | anteaya: openid is a different project, but the user group portal will use the openid for authentication. the auth system is turnod of the groups portal, so we need to find a solution to publish content without using the standard built-in authentication. | 16:06 |
| dhellmann | mordred: yeah, that's what I was thinking | 16:06 |
| mordred | dhellmann: like, "make-me-a-project --python --channels=openstack-infra" | 16:06 |
| dhellmann | it seems like good intern-fodder, since it's not hard to implement, but requires some understanding of what all the files are | 16:07 |
| mrmartin | anteaya: anyway I broke something in a yaml file, so patchset 4 failed, I'm fixing it now | 16:07 |
| dhellmann | mordred: yeah, maybe even with some defaults "make-me-a-project --program oslo oslo.newlib" | 16:07 |
| anteaya | mrmartin: okay, part of that is sort of making sense to me, the patch looks fine for format, there is an error in the alphabetized yaml job that your patch is blocked on | 16:07 |
| openstackgerrit | A change was merged to openstack-infra/config: Creates a publishing job for the infra-manual repo https://review.openstack.org/89421 | 16:08 |
| anteaya | mrmartin: yeah it is the infra-manuals job isn't in alphabetical order | 16:08 |
| anteaya | SergeyLukjanov: you around? | 16:08 |
| *** manishg has quit IRC | 16:08 | |
| *** dstanek is now known as dstanek_zzz | 16:08 | |
| *** manishg has joined #openstack-infra | 16:09 | |
| mrmartin | am I need to include the direct-release option here? | 16:09 |
| anteaya | mrmartin: I have no idea, what is the direct-release option? | 16:10 |
| *** marcoemorais has joined #openstack-infra | 16:10 | |
| mrmartin | anteaya: I don't know, but some project definition contains that, I'll skip it know | 16:10 |
| mordred | anteaya: direct release controls how bugs are closed | 16:10 |
| fungi | direct-release is about how bug handling corresponds to your release model | 16:10 |
| mordred | projects that make releases do not want it | 16:10 |
| anteaya | mordred: thanks | 16:11 |
| mordred | projects like infra/config that do not have releases close bugs as soon as the patch is merged | 16:11 |
| *** ominakov has quit IRC | 16:11 | |
| mordred | and mark the bug "fix released" | 16:11 |
| clarkb | mordred: dhellmann: ya so I think killing the boilerplate with a tool or by making it not necessary is a good thing | 16:11 |
| *** andreaf has quit IRC | 16:11 | |
| mordred | projects like nova mark the bug "fix committed" when the patch merges, and ttx marks things fix released at release tie | 16:11 |
| anteaya | ahh, I will look for a sample of that | 16:11 |
| *** melwitt has joined #openstack-infra | 16:11 | |
| clarkb | mordred: dhellmann: but we should preserve the use gerrit to get gerrit process or have bigger warnings | 16:11 |
| anteaya | after I eat some lunch | 16:11 |
| mordred | clarkb: ++ | 16:11 |
| * anteaya lunches | 16:11 | |
| fungi | anteaya: basically it allows you to skip the "fix committed" step which releasing projects use to differentiate between unreleased and released fixes | 16:12 |
| dhellmann | clarkb: totally behind you on keeping gerrit, I wasn't suggesting removing that step at all | 16:12 |
| openstackgerrit | Marton Kiss proposed a change to openstack-infra/config: Create groups-static-pages project https://review.openstack.org/89734 | 16:12 |
| *** manishg has quit IRC | 16:13 | |
| *** mriedem has quit IRC | 16:13 | |
| *** mriedem has joined #openstack-infra | 16:13 | |
| *** manishg has joined #openstack-infra | 16:13 | |
| openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: Create an oslo-specs repository https://review.openstack.org/92614 | 16:16 |
| *** arnaud has quit IRC | 16:16 | |
| *** thomasem has quit IRC | 16:17 | |
| *** zz_gondoi is now known as gondoi | 16:17 | |
| clarkb | fungi: mordred: there must've been widespread rax networking issues because the ES workers are behind too | 16:17 |
| fungi | clarkb: oh fun! | 16:17 |
| clarkb | I haven't checked yet but I wonder if the cluster is currently recovering from a node flap | 16:17 |
| *** manishg has quit IRC | 16:18 | |
| *** manishg has joined #openstack-infra | 16:18 | |
| *** praneshp has joined #openstack-infra | 16:19 | |
| clarkb | lxsli: I am not aware of the change numbers going away or changing | 16:20 |
| fungi | clarkb: jeblair: phschwartz: got an update on the ticket... i missed the "Cloud Databases | SYD/HKG/IAD/DFW/ORD/LON | iSCSI Maintenance | April 24th 2014- May 7th 2014" noted at https://status.rackspace.com/ | 16:20 |
| fungi | "Due to the nature of this maintenance, a restart will be required for all instances within the assigned maintenance times. Although the maintenance window is 4 hours per data center, Rackspace anticipates your service(s) will be disrupted for a maximum of 15 minutes." | 16:20 |
| clarkb | fungi: is lxsli's question related to something with our gerrit upgrade that I missed? | 16:20 |
| clarkb | fungi: hrm, maybe the ES thing is independent then | 16:20 |
| fungi | clarkb: at what time in the scrollback? | 16:20 |
| clarkb | fungi: 1146UTC | 16:21 |
| *** zns has joined #openstack-infra | 16:21 | |
| *** arnaud has joined #openstack-infra | 16:22 | |
| *** manishg has quit IRC | 16:23 | |
| mrmartin | anteaya: so initial +1 now from Jenkins, https://review.openstack.org/#/c/89734/ | 16:23 |
| fungi | lxsli: clarkb: i don't know anything about short review numbers going away. was that maybe in reference to abbreviated change-ids not working? | 16:23 |
| fungi | zaro: ^ ? | 16:23 |
| *** thomasem has joined #openstack-infra | 16:23 | |
| *** manishg has joined #openstack-infra | 16:23 | |
| openstackgerrit | A change was merged to openstack-infra/config: Fix gerrit database backups https://review.openstack.org/91876 | 16:24 |
| mordred | fungi: the gerrit people want to make the mgo away | 16:27 |
| *** manishg has quit IRC | 16:28 | |
| *** manishg has joined #openstack-infra | 16:28 | |
| *** ramashri has joined #openstack-infra | 16:28 | |
| clarkb | mordred: ah ok so an upstream thing not anything we are doing | 16:30 |
| ociuhandu | ilyashakhat: hello, can you please review again https://review.openstack.org/#/c/92590/ (cloudbase driverlog updates)? First patchset got merge error. Thank you. | 16:30 |
| *** dstanek_zzz is now known as dstanek | 16:30 | |
| clarkb | mordred: also how do you reconcile that with all of the existing changes? | 16:30 |
| mordred | clarkb: god only knows | 16:30 |
| *** dkranz has quit IRC | 16:31 | |
| fungi | mordred: so they want to get rid of the sequential numeric index for the changes table, or what? | 16:31 |
| mordred | fungi: well, they want to get rid of the db altogether | 16:32 |
| fungi | oh! well, that much i can sort of understand | 16:32 |
| mordred | fungi: which would mean they'd need to get ultimatley get rid of the sequential numbers | 16:32 |
| fungi | store everything in git repos basically. got it | 16:32 |
| clarkb | right but that doesn't mean you don't have change numbers | 16:32 |
| *** manishg has quit IRC | 16:32 | |
| clarkb | which might just be change ids or whatever | 16:33 |
| *** yaguang has quit IRC | 16:33 | |
| *** manishg has joined #openstack-infra | 16:33 | |
| clarkb | my bigger concern is how to get from the world with sequential ids to a world without them | 16:33 |
| clarkb | that should be a lot of fun | 16:33 |
| *** Guest74737 has quit IRC | 16:34 | |
| anteaya | mrmartin: +1 and comments summarizing my understanding of our conversation about how the repo will be used | 16:34 |
| *** geertj has quit IRC | 16:34 | |
| *** jgallard has quit IRC | 16:34 | |
| clarkb | https://groups.google.com/forum/#!topic/repo-discuss/xKc1JEaKuzY | 16:35 |
| clarkb | apparently there is a fork of git-review at Ericsson that intentionally submits all changes as drafts by default | 16:36 |
| clarkb | and now they are discovering that drafts are evil | 16:36 |
| *** WaltNik2 has quit IRC | 16:37 | |
| mrmartin | anteaya: thank you. | 16:37 |
| fungi | ha | 16:37 |
| *** manishg has quit IRC | 16:37 | |
| *** manishg has joined #openstack-infra | 16:38 | |
| fungi | that thread is also more proof that drones behind those grey corporate walls don't know how to line-wrap their e-mail messages when posting to technical mailing lists | 16:38 |
| fungi | plus, _so_ much top-posting | 16:39 |
| anteaya | mrmartin: np | 16:39 |
| clarkb | in fairness outlook makes it basically impssible to do email correctly | 16:39 |
| *** gokrokve has quit IRC | 16:40 | |
| clarkb | I cannot get OWA to not top post, default to plaintext with proper quoting and do linewraps at 72chars for me | 16:40 |
| clarkb | (so I don't use OWA to respond to mail lists) | 16:40 |
| mordred | clarkb: actually, you can configure outlook itself to do the right thing | 16:41 |
| mordred | clarkb: OWA is evil - but outlook has all the config settings you need if you care | 16:41 |
| *** hogepodge has joined #openstack-infra | 16:42 | |
| mrmartin | jeblair, fungi: plz, plz. plz: https://review.openstack.org/#/c/89734/ | 16:42 |
| clarkb | mordred: huh | 16:42 |
| clarkb | I still need krotscheck to show me how to exchange with thunderbird | 16:42 |
| clarkb | then I can get rid of this OWA thing | 16:42 |
| *** manishg has quit IRC | 16:42 | |
| mordred | clarkb: it requires a $10 plugin | 16:42 |
| clarkb | oh | 16:43 |
| clarkb | nevermind then | 16:43 |
| clarkb | you all can suffer through my terrible emails when I send them from @hp | 16:43 |
| fungi | you hp hellion you | 16:43 |
| *** dkranz has joined #openstack-infra | 16:44 | |
| *** jpich has quit IRC | 16:45 | |
| clarkb | mrmartin: any reason to have a new core group for that project? does it make sense to use the existing core group for the groups project? | 16:45 |
| *** manishg has joined #openstack-infra | 16:45 | |
| krotscheck | clarkb: I sent an email to mordred on that, let me find it. | 16:46 |
| krotscheck | But I’m not on Ubuntu anymore, so I can’t look at my own config. | 16:46 |
| fungi | clarkb: mrmartin: right. i meant to make the same comment and then forgot after the updated patchset | 16:46 |
| mrmartin | clarkb: yes, must be different from community portal, because the approvals could be a wider group for the content | 16:46 |
| fungi | mrmartin: is it going to be a separate set of people approving changes to that new repository? | 16:46 |
| *** lakshmiS has joined #openstack-infra | 16:46 | |
| krotscheck | clarkb: Sent | 16:46 |
| mrmartin | fungi: yes | 16:46 |
| fungi | mrmartin: okay, fine by me then | 16:47 |
| clarkb | yup as long as that is the intent wfm | 16:47 |
| krotscheck | $10 plugin? | 16:47 |
| krotscheck | I didn’t pay that. | 16:47 |
| fungi | clarkb: in that case, since you are also reviewing it, i'll let you approve when ready | 16:47 |
| krotscheck | The $10 plugin is for calendar sync I think, not for mail | 16:47 |
| clarkb | fungi: ok | 16:47 |
| mordred | krotscheck: there's a way to do it without a $10 plugin? /me goes to look at krotscheck's email again ... | 16:47 |
| krotscheck | Let me doublecheck. | 16:47 |
| *** geertj has joined #openstack-infra | 16:47 | |
| *** bhuvan has joined #openstack-infra | 16:48 | |
| clarkb | fungi: also we should stop adding new projects at some point and do the abandon permissions thing | 16:48 |
| mordred | krotscheck: I can haz new copy of email? :) | 16:48 |
| krotscheck | mordred: Oh, nevermind, you’re right. | 16:48 |
| krotscheck | I was on the trial version which eventually shifts to read only | 16:48 |
| *** yfried has joined #openstack-infra | 16:48 | |
| fungi | clarkb: i'll have a quick look at how to address your objections to that one and cram up a fresh patch for it today | 16:48 |
| mordred | krotscheck: stupid people with their stupid money | 16:49 |
| clarkb | fungi: awesome | 16:49 |
| krotscheck | mordred: Yeah. God forbid someone wants to be paid for writing things taht make our lives confenient | 16:49 |
| krotscheck | Also, me type good engrish | 16:49 |
| clarkb | its less the be paid and more the perpetuating of walls | 16:49 |
| mrmartin | fungi, clarkb: I want to add Stefano, Tom Fifield and Sean Roberts as approvals for this project. | 16:49 |
| *** Hal_ has joined #openstack-infra | 16:50 | |
| clarkb | want to be paid to compete and play nice with eveeryone? great | 16:50 |
| fungi | mrmartin: okay, can do | 16:50 |
| mrmartin | thnx | 16:50 |
| clarkb | mrmartin: is that in addition to the existing groups core group? | 16:50 |
| mrmartin | mrmartin: yep, include me also. | 16:50 |
| fungi | easily done | 16:51 |
| mrmartin | the groups project is the website code, the groups-static-pages just the static content | 16:51 |
| phschwartz | fungi: you know I have that notice in my email and totally missed it | 16:51 |
| clarkb | approved | 16:51 |
| clarkb | krotscheck: particularly since email has some well definied standards and protocols paying to not use those is a bit counterintuitive | 16:52 |
| clarkb | granted the folks asking for $10 here are arguably making someone elses mistake better | 16:52 |
| *** derekh_ has quit IRC | 16:52 | |
| fungi | phschwartz: i was in the habit of ignoring db maintenance notices because we hadn't been using that service, so it fell through the cracks of my apathy i think | 16:52 |
| krotscheck | clarkb: Well, you can always convince HP to move away from M$. | 16:52 |
| fungi | phschwartz: anyway, it serves as a good reminder for us to start paying attention to more than just compute/block/network maintenance notices now ;) | 16:53 |
| openstackgerrit | A change was merged to openstack-infra/config: Create groups-static-pages project https://review.openstack.org/89734 | 16:53 |
| *** chandan_kumar has joined #openstack-infra | 16:54 | |
| *** gokrokve has joined #openstack-infra | 16:54 | |
| fungi | mrmartin: it'll take a few minutes for that ^ to get applied, but once it is i'll update the group member lists and let you know | 16:54 |
| mrmartin | fungi, ok I'll be here later | 16:54 |
| *** mrodden has quit IRC | 16:57 | |
| fungi | clarkb: i'm trying to figure out whether there's a good way to update openstack-api-ref and openstack-api-site in http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/api-jobs.yaml to use a common publisher macro. am i out of luck without the tox env for the first and the underlying git repo for the second being reorganized? | 16:58 |
| * clarkb looks | 16:58 | |
| clarkb | also I should give evolution a shot | 16:58 |
| *** harlowja has joined #openstack-infra | 16:58 | |
| clarkb | apparently it can speak excahnge | 16:58 |
| *** aconrad has joined #openstack-infra | 16:59 | |
| mordred | clarkb: it can - but the last 20 times I've tried it's been a bit crappy | 16:59 |
| pleia2 | worth a try, but I've found most things about evolution to be a bit unstable (which is why Ubuntu defaults to thunderbird now) | 16:59 |
| clarkb | fungi: do they run against the same repo? we might be able to consolidate them into one job that copies the www files and does the tox command | 17:00 |
| *** vhoward has left #openstack-infra | 17:01 | |
| clarkb | which doesn't quite do the same thing but reduces repeitition in other ways | 17:01 |
| fungi | clarkb: i think openstack-api-ref runs against multiple projects | 17:01 |
| *** arnaud has quit IRC | 17:01 | |
| clarkb | fungi: I think you can do what you describe though if the macro takes an argument for source | 17:01 |
| clarkb | fungi: the target is equivalent in both cases and remove prefix can be determined from source | 17:02 |
| YorikSar | anteaya: I guess, that's some default behavior in their instance of Zuul | 17:02 |
| clarkb | something like doc-ftp-pub:\n source: www/ | 17:02 |
| fungi | clarkb: oh, good point | 17:02 |
| fungi | clarkb: since both basically just publish everything under a specified directory to the root of the site | 17:03 |
| clarkb | yup | 17:03 |
| clarkb | so can probably be more generic than doc-ftp-pub too | 17:04 |
| *** dstanek is now known as dstanek_zzz | 17:04 | |
| fungi | though i do have to add a parameter, i guess that's not the end of the world ;) | 17:04 |
| *** ildikov has quit IRC | 17:05 | |
| *** liam_ has joined #openstack-infra | 17:06 | |
| clarkb | ok I need to AFK so that I can properly start this morning | 17:07 |
| clarkb | then I need to debug swift credential issues with zuul | 17:07 |
| fungi | sounds goof | 17:07 |
| fungi | good too | 17:07 |
| *** jooools has quit IRC | 17:08 | |
| *** mrodden has joined #openstack-infra | 17:09 | |
| *** etoews has quit IRC | 17:13 | |
| *** mrmartin has quit IRC | 17:14 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Publish API/CLI/SDK site to developer.o.o https://review.openstack.org/92493 | 17:14 |
| *** russell_h has joined #openstack-infra | 17:14 | |
| *** russell_h has quit IRC | 17:15 | |
| *** russell_h has joined #openstack-infra | 17:15 | |
| *** etoews has joined #openstack-infra | 17:15 | |
| reed | devananda, can you add your bio on http://www.openstack.org/community/members/profile/2772 so that http://www.openstack.org/foundation/tech-committee/ looks pretty? | 17:15 |
| fungi | i find his current bio very zen | 17:16 |
| NobodyCam | morning infra... just poping in to check if I am the only one having issues with paste.openstack.org? | 17:19 |
| NobodyCam | I get the inital screen then Internal Server Error when I click the paste button | 17:20 |
| fungi | NobodyCam: what's the problem? someone was seeing issues yesterday until they deleted an old cookie for that server from their browser | 17:20 |
| *** lcheng_ has quit IRC | 17:20 | |
| fungi | NobodyCam: yeah, that does sound similar | 17:20 |
| *** rcarrill` has joined #openstack-infra | 17:21 | |
| *** gokrokve has quit IRC | 17:21 | |
| fungi | mordred: we've had a few reports of that ^ since the paste.o.o db move... any clue could be causing it? | 17:21 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Added resolveSessionState method https://review.openstack.org/92639 | 17:21 |
| *** zns has quit IRC | 17:21 | |
| *** rcarrillocruz has quit IRC | 17:23 | |
| *** etoews has quit IRC | 17:23 | |
| *** etoews has joined #openstack-infra | 17:23 | |
| * mordred looks | 17:24 | |
| mordred | fungi: unsure. no idea what would cause that | 17:25 |
| *** etoews_ has joined #openstack-infra | 17:26 | |
| *** etoews has quit IRC | 17:26 | |
| clarkb | did cookie data not survive the db migration properly? | 17:26 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Publish API/CLI/SDK site to developer.o.o https://review.openstack.org/92493 | 17:27 |
| fungi | sounds plausible | 17:27 |
| NobodyCam | fungi: yep that got it... TY :) | 17:28 |
| *** mriedem has quit IRC | 17:28 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Created new Dashboard module https://review.openstack.org/92640 | 17:31 |
| *** otherwiseguy has quit IRC | 17:32 | |
| *** zul has quit IRC | 17:32 | |
| *** Ryan_Lane has joined #openstack-infra | 17:32 | |
| *** morganfainberg_Z is now known as morganfainberg | 17:32 | |
| *** morganfainberg is now known as needscoffee | 17:33 | |
| *** needscoffee is now known as morganfainberg | 17:33 | |
| *** krtaylor has quit IRC | 17:33 | |
| *** sandywalsh has joined #openstack-infra | 17:34 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/gear: doc update: move the server usage info https://review.openstack.org/88401 | 17:34 |
| *** salv-orlando has joined #openstack-infra | 17:35 | |
| *** praneshp_ has joined #openstack-infra | 17:37 | |
| *** praneshp has quit IRC | 17:37 | |
| *** praneshp_ is now known as praneshp | 17:37 | |
| devananda | reed: wow, that's old. thanks for the poke | 17:37 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Publish API/CLI/SDK site to developer.o.o https://review.openstack.org/92493 | 17:37 |
| *** pcrews has quit IRC | 17:38 | |
| *** mriedem has joined #openstack-infra | 17:38 | |
| *** gokrokve has joined #openstack-infra | 17:39 | |
| *** ramashri has quit IRC | 17:43 | |
| *** crc32 has joined #openstack-infra | 17:44 | |
| *** Sukhdev has quit IRC | 17:50 | |
| *** zns has joined #openstack-infra | 17:51 | |
| *** jp_at_hp has quit IRC | 17:51 | |
| *** otherwiseguy has joined #openstack-infra | 17:53 | |
| *** packet has joined #openstack-infra | 17:53 | |
| *** arnaud has joined #openstack-infra | 17:53 | |
| *** Ajaeger has joined #openstack-infra | 17:54 | |
| *** wenlock has quit IRC | 17:56 | |
| *** unicell has quit IRC | 17:56 | |
| *** mrmartin has joined #openstack-infra | 17:56 | |
| *** mestery has joined #openstack-infra | 17:57 | |
| harlowja | fungi u got a sec, https://review.openstack.org/#/c/91171/ doesn't seem to be in zuul, but also seems to be in check state? did it like get lost? | 17:57 |
| *** packet has quit IRC | 17:59 | |
| *** mengxd has quit IRC | 17:59 | |
| *** mengxd has joined #openstack-infra | 18:00 | |
| *** mengxd has quit IRC | 18:00 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Added resolveSessionState method https://review.openstack.org/92639 | 18:00 |
| *** mengxd has joined #openstack-infra | 18:00 | |
| *** dims has quit IRC | 18:01 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Created new Dashboard module https://review.openstack.org/92640 | 18:01 |
| *** ramashri has joined #openstack-infra | 18:01 | |
| *** mestery_ has joined #openstack-infra | 18:01 | |
| *** thomasem has quit IRC | 18:02 | |
| *** marcoemorais has quit IRC | 18:02 | |
| *** etoews has joined #openstack-infra | 18:03 | |
| *** melwitt has quit IRC | 18:03 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Removed new story button on index https://review.openstack.org/92645 | 18:03 |
| *** etoews_ has quit IRC | 18:03 | |
| *** marcoemorais has joined #openstack-infra | 18:04 | |
| *** mestery has quit IRC | 18:04 | |
| *** melwitt has joined #openstack-infra | 18:05 | |
| *** mestery_ is now known as mestery | 18:06 | |
| *** mbacchi has quit IRC | 18:06 | |
| *** terryw has joined #openstack-infra | 18:10 | |
| *** james_li has joined #openstack-infra | 18:10 | |
| *** thomasem has joined #openstack-infra | 18:11 | |
| *** otherwiseguy has quit IRC | 18:12 | |
| *** jamespage_ has joined #openstack-infra | 18:12 | |
| *** dstanek_zzz is now known as dstanek | 18:13 | |
| *** morganfainberg has quit IRC | 18:15 | |
| *** andreaf_ has joined #openstack-infra | 18:15 | |
| *** andreaf_ has quit IRC | 18:16 | |
| *** Vivek has quit IRC | 18:16 | |
| *** morganfainberg has joined #openstack-infra | 18:16 | |
| *** andreaf has joined #openstack-infra | 18:16 | |
| *** mengxd has quit IRC | 18:17 | |
| *** Vivek has joined #openstack-infra | 18:17 | |
| *** dprince has quit IRC | 18:17 | |
| *** morganfainberg has quit IRC | 18:18 | |
| *** Vivek is now known as Guest35712 | 18:18 | |
| *** pcrews has joined #openstack-infra | 18:18 | |
| *** adalbas has joined #openstack-infra | 18:19 | |
| *** morganfainberg_Z has joined #openstack-infra | 18:19 | |
| *** morganfainberg_Z is now known as morganfainberg | 18:20 | |
| *** ildikov has joined #openstack-infra | 18:21 | |
| *** darraghb has quit IRC | 18:21 | |
| *** ivar-lazzaro has joined #openstack-infra | 18:21 | |
| fungi | harlowja: https://wiki.openstack.org/wiki/Infrastructure_Status (recheck bug 1317089) | 18:22 |
| uvirtbot | Launchpad bug 1317089 in openstack-ci "Zuul lost jobs due to Gerrit database error on 2014-05-07" [Undecided,New] https://launchpad.net/bugs/1317089 | 18:22 |
| *** salv-orlando has quit IRC | 18:23 | |
| *** jcoufal has joined #openstack-infra | 18:24 | |
| *** krtaylor has joined #openstack-infra | 18:24 | |
| *** zul has joined #openstack-infra | 18:25 | |
| *** mestery has quit IRC | 18:27 | |
| *** mestery has joined #openstack-infra | 18:31 | |
| DinaBelova | folks, o/ Is there a way to run all Jenkins checks on the draft change? I mean, I can add Jenkins as a reviewer and say "recheck no bug", but console.log is empty then | 18:31 |
| *** notmyname has quit IRC | 18:31 | |
| *** notmyname_ has joined #openstack-infra | 18:32 | |
| *** notmyname_ is now known as notmyname | 18:32 | |
| fungi | DinaBelova: we're working toward disabling drafts | 18:33 |
| *** geertj has quit IRC | 18:33 | |
| SergeyLukjanov | clarkb, re your cross project session - I'll try to attend it, it sounds very interesting | 18:33 |
| fungi | DinaBelova: and no, zuul's not really engineered to report on draft events when added as a requested reviewer as far as i know | 18:33 |
| clarkb | SergeyLukjanov: woot | 18:33 |
| DinaBelova | fungi, well, so there is no way now? As I'm trying to catch interesting error, and it's reproducing only in the console.logs of the changes :-\ Locally I simply do not see it | 18:34 |
| SergeyLukjanov | anteaya, I'm here now | 18:35 |
| SergeyLukjanov | reading scrollback :) | 18:36 |
| anteaya | great | 18:36 |
| anteaya | I had a question about the alphabetized yaml job but mrmartin sorted it out | 18:36 |
| fungi | DinaBelova: you could publish the draft change and then add a "recheck no bug" comment on it | 18:36 |
| SergeyLukjanov | anteaya, sorry, I was on meetings | 18:37 |
| fungi | DinaBelova: but really the only reason we have draft support in gerrit is that we're not (yet) on a new enough version to be able to disable it completely. we have "work in progress" (workflow -1 votes) to designate changes which aren't ready for review or are test changes nobody needs to care about | 18:37 |
| DinaBelova | fungi, ok, I just wanted not to spam list of the changes))) okay, will do | 18:38 |
| fungi | DinaBelova: yep, that's one of the intended uses for the workflow -1 vote | 18:39 |
| clarkb | so I can reproduce the swift failure on the zuul box | 18:39 |
| anteaya | SergeyLukjanov: np, you are allowed, I hope they were the wonderful adventerous kind of meetings | 18:40 |
| openstackgerrit | james-li-3 proposed a change to openstack-infra/config: Enables SOLUM_INSTALL_CEDARISH https://review.openstack.org/92655 | 18:41 |
| anteaya | not the rip your soul from your body kind of meetings | 18:41 |
| clarkb | tenant with name/id openstackjenkins is not valid for the rw files user | 18:41 |
| clarkb | getting somewhere | 18:41 |
| *** weshay has quit IRC | 18:41 | |
| SergeyLukjanov | anteaya, it was the second kind of meetings :( | 18:42 |
| SergeyLukjanov | like marketing bullshit | 18:42 |
| *** etoews_ has joined #openstack-infra | 18:42 | |
| anteaya | wow | 18:43 |
| *** mbacchi has joined #openstack-infra | 18:43 | |
| * anteaya hands SergeyLukjanov a beer | 18:43 | |
| anteaya | I'm sorry for your loss | 18:43 |
| SergeyLukjanov | anteaya, thx :) | 18:43 |
| anteaya | :D | 18:44 |
| SergeyLukjanov | anteaya, me still have an item in backlog re adding some check sorting by regex | 18:44 |
| harlowja | fungi thx | 18:44 |
| SergeyLukjanov | anteaya to add more checks for sorting in infra/config | 18:44 |
| *** etoews has quit IRC | 18:44 | |
| *** esker has quit IRC | 18:45 | |
| fungi | clarkb: you're comparing against the limited access accounts i added in the rackspace web dashboard, right? | 18:46 |
| *** james_li has quit IRC | 18:46 | |
| *** Hal_ has quit IRC | 18:46 | |
| clarkb | fungi: no currently logged in as the limited access account to see if it includes connection info anywhere and it doesn't appear to | 18:47 |
| *** otherwiseguy has joined #openstack-infra | 18:47 | |
| clarkb | going to log in as the regular account and see if that says anything | 18:48 |
| anteaya | SergeyLukjanov: sounds good | 18:48 |
| fungi | yeah, looking at the user management pane for it now | 18:48 |
| clarkb | woot figured it out | 18:48 |
| fungi | oh? | 18:48 |
| clarkb | tenant id/name is a number | 18:48 |
| fungi | ahh, yes that | 18:48 |
| fungi | should be the account id number | 18:49 |
| clarkb | fungi: I compared to the stuff in ci launch | 18:49 |
| fungi | 6-digit integer | 18:49 |
| clarkb | yup | 18:50 |
| clarkb | now should that be secret or can it go in the git repo? | 18:50 |
| clarkb | I will whip up a change either way. I don't think it is secret | 18:50 |
| *** terryw has quit IRC | 18:51 | |
| *** kgriffs is now known as kgriffs|afk | 18:51 | |
| clarkb | but now it is complaining about the region name not being specific using the cli client | 18:52 |
| clarkb | so may be more to sort out | 18:52 |
| fungi | clarkb: looking for precedent, nodepool_rackspace_project is in hiera with that value currently | 18:52 |
| clarkb | ok I will hiera it then | 18:53 |
| *** esker has joined #openstack-infra | 18:53 | |
| fungi | i agree it may not be particularly sensitive, but we already seem to be keeping it in there for other uses so might as well continue for consistency | 18:53 |
| *** dstanek is now known as dstanek_zzz | 18:54 | |
| *** _nadya_ has joined #openstack-infra | 18:55 | |
| *** weshay has joined #openstack-infra | 18:55 | |
| *** doug-fish has quit IRC | 18:55 | |
| *** jamespage_ has quit IRC | 18:55 | |
| *** doug-fish has joined #openstack-infra | 18:55 | |
| clarkb | ClientException: Endpoint for object-store not found - have you specified a region? | 18:55 |
| *** mriedem has quit IRC | 18:55 | |
| clarkb | keystone catalog does not return an object-store item | 18:55 |
| fungi | this is a common theme. i have worked around the glance endpoint at rackspace similarly | 18:56 |
| fungi | clarkb: are you trying to use openstackclient instead of swiftclient? | 18:56 |
| fungi | openstackclient presently just doesn't deal with services which aren't in the keystone service catalog | 18:57 |
| *** mriedem has joined #openstack-infra | 18:57 | |
| clarkb | no this is `swift --info list` | 18:57 |
| fungi | oh, neat | 18:57 |
| clarkb | swift attempts to create a keystone client object but that fails because there is no object-store | 18:58 |
| clarkb | talking keystone directly seems to confirm that is the case | 18:58 |
| clarkb | any rax folks around that know how to make swiftclient + keystoneclient grok DFW swift? | 18:58 |
| fungi | clarkb: using https://auth.api.rackspacecloud.com/v1.0 presumably? | 18:59 |
| clarkb | https://community.rackspace.com/products/f/25/t/3287 | 18:59 |
| clarkb | no jheskeths change was all v2 | 18:59 |
| clarkb | going to try v1 now | 19:00 |
| fungi | i think you have to use auth v 1.0 with rackspace (last i tried) | 19:00 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Added story status label directive https://review.openstack.org/92661 | 19:01 |
| fungi | oh, that discussion talks about passing --os-tenant-name ' ' when using v2 auth | 19:01 |
| clarkb | now authorization fails | 19:01 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Added simple logged-in dashboard https://review.openstack.org/92662 | 19:01 |
| fungi | clarkb: http://blog.chmouel.com/2013/09/27/how-to-access-rackspace-cloud-with-latest-swiftclient-novaclient/ | 19:02 |
| * clarkb tries unsetting os tenant name | 19:02 | |
| *** arnaud__ has joined #openstack-infra | 19:02 | |
| *** geertj has joined #openstack-infra | 19:03 | |
| *** e0ne has joined #openstack-infra | 19:03 | |
| clarkb | and that worked | 19:03 |
| clarkb | chmouel++ | 19:03 |
| fungi | on the shoulders of giants | 19:04 |
| *** esker has quit IRC | 19:04 | |
| *** homeless has joined #openstack-infra | 19:04 | |
| clarkb | thats just I don't even wow | 19:04 |
| clarkb | guys I think that means your identity service isn't keystone compliant | 19:04 |
| * mgagne is flabbergasted | 19:04 | |
| fungi | a shocking suggestion, that is | 19:05 |
| clarkb | note I actually had to set the name to a space not make it actually empty | 19:05 |
| fungi | yep, that's what his article said too | 19:05 |
| openstackgerrit | Marton Kiss proposed a change to openstack-infra/config: Fetch content from groups-static-pages repository https://review.openstack.org/92664 | 19:05 |
| fungi | mrmartin: oh, you're back! anyway, i added you to both groups and the other three you requested to the core group... https://review.openstack.org/#/admin/groups/341,members https://review.openstack.org/#/admin/groups/340,members | 19:06 |
| clarkb | now to figure out how to get this in an ini file in such a way that puppet and python will do the correct thing with it | 19:06 |
| *** arnaud__ has quit IRC | 19:07 | |
| fungi | heh, yeah, that's going to be a trick and a halp | 19:07 |
| fungi | half | 19:07 |
| mrmartin | fungi, great, and don't you know when will be the source github repo cloned into openstack-infra/groups-static-pages? | 19:07 |
| fungi | mrmartin: looks like it already was | 19:08 |
| mrmartin | fungi, oh, I see | 19:08 |
| clarkb | fungi: or I could figure out v1.0 possibly | 19:09 |
| clarkb | but that didn't seem to work at all which makes me think maybe the rbac stuff is v2.0 only? | 19:09 |
| fungi | mrmartin: that's supposed to happen automatically, but if it seems it didn't then let me know | 19:09 |
| mrmartin | fungi, will this repo cloned somehow into github.com/openstack-infra/ ? | 19:09 |
| clarkb | meh /me debugs some python configparser | 19:09 |
| fungi | checking | 19:09 |
| *** mrodden1 has joined #openstack-infra | 19:09 | |
| *** mrodden has quit IRC | 19:09 | |
| mrmartin | the repo is there, but it seems to be empty: https://github.com/openstack-infra/groups-static-pages | 19:10 |
| fungi | mrmartin: interesting--looks like we created it but didn't replicate to it successfully. i'll re-trigger replication for that project real quick and then investigate in the logs for a cause | 19:10 |
| mrmartin | fungi, thanks | 19:10 |
| *** sdake_ has quit IRC | 19:10 | |
| mgagne | fungi: what about glance? I'm getting a 404 :-/ | 19:11 |
| fungi | mgagne: huh? where? | 19:12 |
| mgagne | fungi: sorry, rackspace =) | 19:12 |
| mgagne | fungi: or should I still go through nova even though glance endpoints are available in the catalog? | 19:13 |
| fungi | mgagne: yeah the workaround i used for glance was to wrap openstackclient in a script which redirected image commands to glanceclient with a different api endpoint | 19:13 |
| clarkb | wow this is going to be fun | 19:14 |
| mgagne | fungi: could you elaborate on the "different api endpoint" part? | 19:14 |
| clarkb | looks like ConfigParser strips whitespace and thats how it works | 19:14 |
| fungi | mgagne: because openstackclient doesn't use the novaclient api to do image operations | 19:14 |
| mgagne | fungi: ok, so you mean redirecting openstackclient image calls to nova endpoint? | 19:14 |
| fungi | mgagne: rackspace's glance service isn't in their keystone service catalog, or at least wasn't last time i checked (a few weeks ago) | 19:14 |
| clarkb | I suppose I can patch zuul to hardcode that to an empty space | 19:14 |
| clarkb | :( | 19:14 |
| mgagne | fungi: it is for me | 19:14 |
| clarkb | as the default value then we just don't specify a value | 19:15 |
| fungi | mgagne: oh! with the correct url? | 19:15 |
| clarkb | but that still allows others to use non space values if they need it | 19:15 |
| mgagne | fungi: correct is a bit strong =) | 19:15 |
| fungi | mgagne: openstackclient seemed to be unable to find it starting from the keystone api endpoint | 19:16 |
| fungi | mgagne: but i was able to get it to work by calling glanceclient directly with the glance-specific endpoint | 19:16 |
| *** jp_at_hp has joined #openstack-infra | 19:16 | |
| mgagne | fungi: http://paste.openstack.org/show/79460/ | 19:16 |
| mgagne | fungi: glance image-list returns a 404 | 19:17 |
| *** esker has joined #openstack-infra | 19:17 | |
| clarkb | I wonder if the current code which defaults to None would work | 19:17 |
| fungi | mgagne: i use OS_IMAGE_API_VERSION=2 and OS_IMAGE_URL=https://$OS_REGION_NAME.images.api.rackspacecloud.com when calling glanceclient and it works for me | 19:18 |
| fungi | (fill in your own $OS_REGION_NAME of course) | 19:18 |
| mgagne | fungi: will test | 19:19 |
| *** zul has quit IRC | 19:22 | |
| openstackgerrit | Marton Kiss proposed a change to openstack-infra/config: Fetch content from groups-static-pages repository https://review.openstack.org/92664 | 19:22 |
| *** kgriffs|afk is now known as kgriffs | 19:22 | |
| * clarkb tries it with some interactive python | 19:23 | |
| fungi | wow, i ended up having to go digging inside of gerritlib to figure out the new replicate syntax | 19:23 |
| *** UtahDave has joined #openstack-infra | 19:23 | |
| fungi | fun times | 19:23 |
| mgagne | fungi: it's working! thanks! | 19:25 |
| fungi | mgagne: glad that helped someone. took me an hour or more to figure out and work around | 19:26 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/statusbot: Update to pbr-based build https://review.openstack.org/92676 | 19:26 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/statusbot: Add twitter support to statusbot https://review.openstack.org/92677 | 19:26 |
| fungi | huh, the git push for replicating openstack-infra/groups-static-pages is still in the gerrit queue | 19:26 |
| mordred | clarkb: turns out it's a really small amount of code to add that ^^ | 19:26 |
| fungi | it's on "retry 11" now | 19:26 |
| mordred | fungi: wow | 19:26 |
| fungi | i'll dig into the logs in a sec | 19:27 |
| *** _nadya_ has quit IRC | 19:27 | |
| clarkb | mordred: you see this rax identity stff? | 19:27 |
| *** esker has quit IRC | 19:28 | |
| *** zul has joined #openstack-infra | 19:28 | |
| mordred | clarkb: no - lemme read scrollback | 19:28 |
| clarkb | fungi: I constructed a keystone client by hand in the same way that swift does it but repalced tenant_name=' ' with None and that worked | 19:30 |
| clarkb | fungi: so I think we can make this work by omitting the tenant name in the zuul ini | 19:30 |
| *** hashar has joined #openstack-infra | 19:31 | |
| mordred | clarkb: wow. everything about that is fantastic | 19:31 |
| *** manishg has quit IRC | 19:31 | |
| *** kgriffs is now known as kgriffs|afk | 19:32 | |
| fungi | clarkb: sounds reasonable (for unreasonable definitions of reasonable) | 19:32 |
| clarkb | I will propose that little edit atop jheskeths original change | 19:32 |
| mordred | shouldn't most of that info come via the keystone catalog? | 19:32 |
| clarkb | mordred: you need the tenant name to construct a catalog | 19:32 |
| mordred | gotcha | 19:32 |
| clarkb | mordred: but! rax identity doesn't do that correctlky | 19:33 |
| mordred | except they dont' have tenant names, yeah? | 19:33 |
| mordred | sweet | 19:33 |
| mordred | well, thank god they're not running keystone, since keystone is bad software, and instead wrote something that works better in java | 19:33 |
| clarkb | apparently giving it a None tenant name fixes the problem | 19:33 |
| mordred | that's working out excellently | 19:33 |
| clarkb | as does giving it a space | 19:33 |
| *** amcrn has joined #openstack-infra | 19:33 | |
| mordred | clarkb: that makes me cry | 19:33 |
| clarkb | but setting a value to ' ' in configparser is hard | 19:33 |
| clarkb | so I am just going to omit the value completely and rely on None | 19:34 |
| mordred | clarkb: ++ | 19:34 |
| *** andreaf has quit IRC | 19:34 | |
| clarkb | mordred: to make things even worse you do get a catalog back when you provide a valid tenant name | 19:37 |
| *** sdake_ has joined #openstack-infra | 19:38 | |
| clarkb | mordred: you just don't get the entire catalog back so no object-store entry | 19:38 |
| *** manishg has joined #openstack-infra | 19:39 | |
| *** e0ne has quit IRC | 19:39 | |
| clarkb | fungi: did you actually end up creating the infra-files-rw account or was that jeblair? | 19:40 |
| clarkb | fungi: want to make sure the commit message is correct | 19:40 |
| mordred | clarkb: that makes me want to go eat food | 19:40 |
| *** e0ne has joined #openstack-infra | 19:40 | |
| fungi | clarkb: i created it, pretty sure | 19:40 |
| fungi | not that i'm looking for credit in a commit message. easier to claim it wasn't me later when it breaks ;) | 19:41 |
| clarkb | fungi: nah it was there once | 19:41 |
| clarkb | good enough for me now | 19:41 |
| fungi | clarkb: i also created a -ro account to use on the log server | 19:42 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/statusbot: Add twitter support to statusbot https://review.openstack.org/92677 | 19:42 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/statusbot: Update to pbr-based build https://review.openstack.org/92676 | 19:42 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Configure swift credentials for workers to push to https://review.openstack.org/92683 | 19:43 |
| clarkb | fungi: mordred ^ | 19:43 |
| clarkb | that *should* do it and if it doesn't then I think we should all take a long vacation | 19:43 |
| clarkb | and now time for lunch back soo | 19:44 |
| *** wenlock has joined #openstack-infra | 19:46 | |
| *** dims has joined #openstack-infra | 19:47 | |
| *** mrmartin has quit IRC | 19:48 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Update get-pip URL to the new location https://review.openstack.org/92225 | 19:48 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Changes to get nodepool working with trusty https://review.openstack.org/88477 | 19:48 |
| *** esker has joined #openstack-infra | 19:48 | |
| openstackgerrit | Paul Belanger proposed a change to openstack-infra/jeepyb: Add PostgreSQL database support for gerritdb https://review.openstack.org/92686 | 19:48 |
| *** Ajaeger has quit IRC | 19:49 | |
| *** ociuhandu has quit IRC | 19:50 | |
| *** sdake_ has quit IRC | 19:51 | |
| SlickNik | Hey guys | 19:54 |
| SlickNik | I'm having some trouble adding cp16net to the trove-core gerrit group. | 19:55 |
| fungi | oh? | 19:55 |
| fungi | #define trouble | 19:55 |
| SlickNik | There's 2 users with the same name in the system. | 19:55 |
| fungi | now that's fun | 19:55 |
| SlickNik | One with an email address and one without. | 19:55 |
| cp16net | i have the account id of the one i use if that helps | 19:56 |
| SlickNik | I can add the one without the email address just fine, but that doesn't seem to do much. | 19:56 |
| fungi | the one with the e-mail address is the one you want. he probably has more than one gerrit account and we blanked out the preferred email on the old one | 19:56 |
| *** eharney has quit IRC | 19:56 | |
| cp16net | yeah thats probably what happened | 19:56 |
| fungi | you can also add him by ssh username or by numeric user id | 19:56 |
| SlickNik | And when I try to add the other user with the email address, it barfs with a "Account Not Found" error. | 19:56 |
| cp16net | i know way back there were some weird issues with my users on gerrit | 19:57 |
| fungi | now THAT is not something it should be doing | 19:57 |
| cp16net | lol | 19:57 |
| cp16net | story of my life.. | 19:57 |
| SlickNik | I tried using the numeric id as well, but the symptoms don't improve. :) | 19:57 |
| fungi | i can recreate the behavior in the requested reviewers input box on a change too | 19:58 |
| cp16net | hmmm | 19:58 |
| fungi | checking in the db to see if something's a little off | 19:58 |
| cp16net | i see 2 identities in my settings on gerrit | 19:58 |
| cp16net | wonder if i delete the non email address one it would be better? | 19:59 |
| *** Ryan_Lane1 has joined #openstack-infra | 19:59 | |
| *** lakshmiS has quit IRC | 19:59 | |
| cp16net | oh there is a user cp16net and a user craig vyvial | 19:59 |
| *** SumitNaiksatam has quit IRC | 19:59 | |
| fungi | cp16net: i probably added your old and new openid urls so that if you ever authenticated with the old one again it wouldn't repopulate youre e-mail address and start conflicting again | 19:59 |
| cp16net | ah ye | 20:00 |
| *** Ryan_Lane has quit IRC | 20:01 | |
| fungi | in the db we have two accounts for Craig Vyvial in the accounts table, 1175 (the one with no preferred_email) and 4240 | 20:02 |
| *** manishg_ has joined #openstack-infra | 20:02 | |
| cp16net | ok https://login.launchpad.net/+id/6dPX8ph | 20:02 |
| *** manishg has quit IRC | 20:02 | |
| cp16net | whoops | 20:02 |
| cp16net | the 4240 is the one i am using | 20:02 |
| fungi | yeah, 4240 looks like the right one now | 20:02 |
| SlickNik | It let me add 4240 | 20:03 |
| *** wenlock has quit IRC | 20:03 | |
| fungi | however the old e-mail address is still also in the external_ids table for 1175 | 20:03 |
| fungi | i'll remove that row | 20:03 |
| fungi | and flushed the caches | 20:04 |
| fungi | and now i can add/remove cp16net as a reviewer on a change | 20:05 |
| SlickNik | I can confirm that adding via email / username works correctly as well now. | 20:05 |
| fungi | SlickNik: cp16net: should be all set | 20:05 |
| SlickNik | Thanks fungi! | 20:05 |
| SlickNik | Yup | 20:05 |
| fungi | yw! | 20:05 |
| cp16net | w00t thanks fungi | 20:05 |
| *** manishg_ has quit IRC | 20:06 | |
| *** ramashri has quit IRC | 20:07 | |
| *** manishg has joined #openstack-infra | 20:07 | |
| *** ramashri has joined #openstack-infra | 20:08 | |
| *** jcoufal has quit IRC | 20:08 | |
| openstackgerrit | Verónica Musso proposed a change to openstack/requirements: Add django-angular as requirement https://review.openstack.org/92690 | 20:10 |
| hashar | oh | 20:10 |
| fungi | clarkb: mordred: java.io.IOException: Creating directories for /opt/lib/git/openstack-infra/groups-static-pages.git failed | 20:10 |
| fungi | so there's that | 20:10 |
| fungi | oh, and then... | 20:11 |
| fungi | com.googlesource.gerrit.plugins.replication.ReplicationQueue : Cannot replicate to git@github.com:openstack-infra/groups-static-pages.git | 20:11 |
| *** manishg has quit IRC | 20:11 | |
| fungi | aha! | 20:11 |
| fungi | org.eclipse.jgit.errors.TransportException: git@github.com:openstack-infra/groups-static-pages.git: push not permitted | 20:11 |
| *** terryw has joined #openstack-infra | 20:12 | |
| *** manishg has joined #openstack-infra | 20:12 | |
| cp16net | fungi: another quick question. does the new gerrit screen not support +2? | 20:12 |
| *** mrodden1 has quit IRC | 20:13 | |
| *** mrodden has joined #openstack-infra | 20:13 | |
| *** rlandy__ has joined #openstack-infra | 20:13 | |
| *** Guest59433 has joined #openstack-infra | 20:13 | |
| fungi | cp16net: i think it does (though it's been a while since i tested the new view--i mainly stick to the old review screen) | 20:13 |
| *** esker has quit IRC | 20:13 | |
| *** Guest59433 is now known as annegentle_ | 20:14 | |
| cp16net | ahh ok | 20:14 |
| cp16net | old one shows me the +2 but new doesnt | 20:14 |
| cp16net | wasnt sure but SlickNik said it shows up for him.. dunno what the deal is | 20:14 |
| *** geertj has quit IRC | 20:14 | |
| mordred | we're pretty sure that the new screen is probably broken in most ways | 20:14 |
| *** otherwiseguy has quit IRC | 20:14 | |
| *** rlandy_ has quit IRC | 20:15 | |
| *** ociuhandu has joined #openstack-infra | 20:16 | |
| *** esker has joined #openstack-infra | 20:16 | |
| *** Ryan_Lane1 is now known as Ryan_Lane | 20:16 | |
| *** Ryan_Lane has quit IRC | 20:16 | |
| *** Ryan_Lane has joined #openstack-infra | 20:16 | |
| *** manishg has quit IRC | 20:17 | |
| *** esker has quit IRC | 20:17 | |
| *** manishg has joined #openstack-infra | 20:17 | |
| fungi | dhellmann: was https://pythonhosted.org/sphinxcontrib-aafig/ the extension you were recommending for embedding ascii diagrams in restructuredtext? | 20:18 |
| *** SumitNaiksatam has joined #openstack-infra | 20:18 | |
| fungi | i see there's also http://blockdiag.com/en/blockdiag/sphinxcontrib.html#sphinxcontrib-blockdiag | 20:18 |
| fungi | which i guess is less wysiwyg and more declarative | 20:19 |
| *** spredzy has left #openstack-infra | 20:20 | |
| *** mengxd has joined #openstack-infra | 20:21 | |
| *** dizquierdo has joined #openstack-infra | 20:22 | |
| *** manishg has quit IRC | 20:22 | |
| *** kgriffs|afk is now known as kgriffs | 20:22 | |
| *** manishg has joined #openstack-infra | 20:23 | |
| fungi | mordred: so comparing github projects, it looks like gerrit didn't get automagically added to the teams list for openstack-infra/groups-static-pages on github, though other recently-created projects have it just fine | 20:23 |
| *** xdmeng has joined #openstack-infra | 20:26 | |
| fungi | mordred: once i added gerrit to the teams list on that project, replication proceeded on its own with no problem | 20:26 |
| *** hashar has quit IRC | 20:26 | |
| *** mengxd has quit IRC | 20:27 | |
| *** manishg has quit IRC | 20:27 | |
| mrodden | are there any infra docs on how the tagging and release to pypi to works? re: getting openstack-dev/bash8 published to pypi | 20:28 |
| *** manishg has joined #openstack-infra | 20:28 | |
| mrodden | i can read through the jenkins yaml defs if there isn't any | 20:28 |
| *** markmc has quit IRC | 20:28 | |
| mordred | fungi: that's spectacular | 20:29 |
| fungi | mrodden: as in configuring all the right bits for automation, or the actual steps to release | 20:29 |
| mordred | fungi: oh - you know what - this may be related to github api ratelimiting issues we've been seeing | 20:29 |
| mrodden | fungi: both probably... | 20:29 |
| mrodden | but more actual steps to release | 20:29 |
| mordred | fungi: which is one of the reasons I keep trying to write a patch that makes sense that does _less_ api calls - since we're doing a bunch of needless updates | 20:29 |
| *** xdmeng has quit IRC | 20:30 | |
| fungi | mrodden: https://wiki.openstack.org/wiki/GerritJenkinsGit#Tagging_a_Release | 20:30 |
| fungi | mrodden: i'll give the current config a quick once-over and see if it looks like it's in shape | 20:30 |
| mrodden | fungi: cool thanks, i'll read this through quick | 20:30 |
| fungi | mrodden: quick question though... bash8 is for doing static analysis of shell scripts... we really want that installable via pip for some reason? or is it just that it's the only way we publish tools as a project? | 20:31 |
| fungi | is it a python program which analyzes shell, or a shell program? | 20:32 |
| mrodden | its python | 20:32 |
| mrodden | analyzes shell | 20:32 |
| fungi | oh, that makes sense then ;) | 20:32 |
| mrodden | heh | 20:32 |
| mrodden | yeah | 20:32 |
| mrodden | valid question | 20:32 |
| fungi | also, i could have looked at the repo (need to anyway to make sure your tox.ini is in order) | 20:32 |
| mrodden | yeah i have a few pending commits to clean up some of it | 20:32 |
| jeblair | i just sent an email to the infra list with a call for people to make sure that if they have proposed an infra summit session to make sure they have an etherpad populated and it's listed here: https://wiki.openstack.org/wiki/Summit/Juno/Etherpads#Infrastructure | 20:32 |
| *** manishg has quit IRC | 20:33 | |
| mrodden | but i want to get the steps figured out so i'm ready at least | 20:33 |
| *** julim has quit IRC | 20:33 | |
| *** manishg has joined #openstack-infra | 20:33 | |
| *** weshay has quit IRC | 20:33 | |
| fungi | mrodden: one missing bit is you don't have any pre-release or release pipeline jobs at http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml#n2477 | 20:34 |
| fungi | mrodden: another is that you need the pypi-jobs group instantiated at http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/projects.yaml#n2424 | 20:35 |
| mrodden | ok | 20:35 |
| fungi | mrodden: and lastly (i think, hopefully) we don't have https://pypi.python.org/pypi/bash8 registered | 20:36 |
| fungi | i can take care of all that for you if you like | 20:36 |
| *** eharney has joined #openstack-infra | 20:36 | |
| mrodden | sure... so basically, need pypi-jobs so the publishing jobs get created in Jenkins, and then update the layout.yaml to use those jobs in the pre-release and release pipelines? | 20:37 |
| mrodden | and then obviously the pypi namespace because we need a place to publish to | 20:37 |
| mrodden | then its just a matter of pushing a signed git tag to the Gerrit repo and the jenkins jobs will take care of the rest? | 20:37 |
| *** manishg has quit IRC | 20:37 | |
| fungi | yep and the pypi project gets registered with basically all fields empty except the (required) version, which i'll set to 0, and then add the openstackci account as a package index owner | 20:38 |
| mrodden | ok | 20:38 |
| mrodden | cool | 20:38 |
| fungi | which is the account the jenkins slave uploads with | 20:38 |
| *** manishg has joined #openstack-infra | 20:38 | |
| mrodden | yeah sounds good. i can build the patch if you want me to. i don't mean to push all the work off to someone else | 20:39 |
| mrodden | for the layout.yaml and jenkins jobs | 20:39 |
| *** amcrn has quit IRC | 20:39 | |
| fungi | mrodden: oh, that's great if you want to. i'll be happy to review it | 20:39 |
| mrodden | k | 20:39 |
| mrodden | i'll take care of that | 20:39 |
| *** jamielennox|away is now known as jamielennox | 20:39 | |
| mrodden | i haven't worked with pypi before, so if you wanted to do that part i'd appreciate it | 20:39 |
| *** mwagner_ has quit IRC | 20:39 | |
| fungi | mrodden: just spotted one more problem too, which probably needs to be addressed in bash8's repo... i don't see any evidence your tarball jobs are working yet. i'll pull a recent log for you | 20:39 |
| fungi | mrodden: oh, sure if you don't already have a pypi account then it's a pain | 20:40 |
| mrodden | ah yeah that would be good to check | 20:40 |
| mrodden | yeah i dont have one :( | 20:40 |
| ArxCruz | jeblair: clarkb why did you guys remove the DEVSTACK_GATE_MQ_DRIVER check from devstack-vm-gate.sh ? | 20:40 |
| *** terryw has quit IRC | 20:41 | |
| fungi | mrodden: https://pypi.python.org/pypi/bash8 is now registered | 20:42 |
| *** manishg has quit IRC | 20:42 | |
| *** esker has joined #openstack-infra | 20:43 | |
| mrodden | fungi: cool, working on config patch now | 20:43 |
| *** manishg has joined #openstack-infra | 20:44 | |
| *** esker has quit IRC | 20:44 | |
| fungi | mrodden: oh... i think maybe the reason you have no tarballs yet is that your branch-tarball job has been added more recently than your last commit was merged? | 20:45 |
| jeblair | ArxCruz: can you point to a commit? | 20:45 |
| ArxCruz | jeblair: looking for | 20:46 |
| ArxCruz | jeblair: nevermind, it's on the test-matrix.py | 20:46 |
| mrodden | fungi: yeah its a branch new project | 20:46 |
| jeblair | ArxCruz: yeah, i was about to suggest that might be where it ended up | 20:46 |
| mrodden | i'm not sure if branch-tarball is the correct job either now that i'm looking at this a bit closer | 20:46 |
| *** weshay has joined #openstack-infra | 20:46 | |
| mrodden | maybe it was just supposed to be tarball | 20:46 |
| *** esker has joined #openstack-infra | 20:47 | |
| fungi | mrodden: branch-tarball runs in the post pipeline, tarball runs in pre-release and release pipelines | 20:47 |
| mrodden | oh ok | 20:47 |
| fungi | mrodden: branch-tarball overwrites the previous branch-tip tarball on each merge to a branch | 20:47 |
| mrodden | i will probably only have one branch for now | 20:47 |
| mrodden | master... and then do tagged releases off that | 20:47 |
| ArxCruz | jeblair: yup, since i'm using a local devstack-vm-gate.sh I need to copy everything | 20:48 |
| *** manishg has quit IRC | 20:48 | |
| ArxCruz | forgot the features.yaml that's why in my test env was using rabbit instead of qpid | 20:48 |
| *** manishg has joined #openstack-infra | 20:48 | |
| *** e0ne has quit IRC | 20:49 | |
| *** e0ne has joined #openstack-infra | 20:49 | |
| fungi | mrodden: yeah, so branch-tarball running in the post pipeline will keep the latest state available as bash8-master.tar.gz on tarballs.o.o and then the tarball jobs in the pre-release and release pipelines create individual versioned tarballs like bash8-1.2.3.tar.gz which will be available from tarballs.o.o in perpetuity | 20:50 |
| *** freyes has joined #openstack-infra | 20:50 | |
| mrodden | oh ok, so its like a maven snapshot release | 20:50 |
| fungi | they serve different purposes and have slightly different behavior, hence why you probably want both | 20:50 |
| fungi | right. updated snapshot of the current state of each branch (or your one branch if you only have one) | 20:51 |
| *** esker has quit IRC | 20:51 | |
| *** esker has joined #openstack-infra | 20:51 | |
| *** manishg has quit IRC | 20:52 | |
| *** manishg has joined #openstack-infra | 20:53 | |
| *** e0ne has quit IRC | 20:53 | |
| mrodden | fungi: i dont really have docs yet in the project, is that alright or should i exclude the bash8-docs from the pre-release and release pipelines? | 20:54 |
| *** lakshmiS has joined #openstack-infra | 20:54 | |
| *** otherwiseguy has joined #openstack-infra | 20:55 | |
| mrodden | looking at pbr and hacking as examples for layout.yaml | 20:55 |
| clarkb | fungi: did the project creation for new groups thing get fixed? | 20:55 |
| *** thomasem has quit IRC | 20:55 | |
| fungi | mrodden: you can include them and then get some stub docs working. if jobs fail in post/pre-release/release then it doesn't stop other jobs unless they're marked as being in a dependent order (like tarball: pypi-upload) | 20:55 |
| fungi | clarkb: seems to have | 20:56 |
| fungi | clarkb: oh, that | 20:56 |
| fungi | clarkb: though you meant gerrit group creation | 20:56 |
| clarkb | no the replication | 20:56 |
| clarkb | sorry catching up after lunch | 20:56 |
| fungi | clarkb: yeah, the issue seems to be that manage-projects failed adding the gerrit "team" for access to the new project after it created it | 20:56 |
| fungi | on github | 20:57 |
| fungi | so then gerrit didn't have permission to push to it on github | 20:57 |
| *** manishg has quit IRC | 20:57 | |
| fungi | mrodden: also i just checked out bash8 and ran 'tox -e venv python setup.py sdist' which produces a sane-looking tarball in dist, so you should be all set on that front | 20:58 |
| *** homeless has quit IRC | 20:58 | |
| fungi | as that's basically the command the job will use to do the same thing | 20:58 |
| *** manishg has joined #openstack-infra | 20:58 | |
| mrodden | fungi: ok cool. | 20:58 |
| fungi | the version on it is a little wonky because pbr can't really give a sane version number when there's never been a tag, but that's to be expected | 20:59 |
| mrodden | i'm gonna skip the docs for now since i realized i dont even have jenkins jobs for those yet... | 20:59 |
| mrodden | yeah | 20:59 |
| mrodden | needs the tag or version in setup.cfg i'm sure | 20:59 |
| fungi | mrodden: yep | 20:59 |
| fungi | or passed as an envvar or... | 20:59 |
| mrodden | heh | 21:00 |
| fungi | there are several ways to do that | 21:00 |
| *** e0ne has joined #openstack-infra | 21:00 | |
| *** jasondotstar has quit IRC | 21:01 | |
| *** bhuvan_ has joined #openstack-infra | 21:02 | |
| mordred | clarkb: I think its' a github ratelimit issue | 21:02 |
| *** arnaud_ has joined #openstack-infra | 21:02 | |
| mordred | clarkb: which is why I think we need to do less github things in m-p | 21:02 |
| *** manishg has quit IRC | 21:02 | |
| *** annegentle_ has quit IRC | 21:03 | |
| *** e0ne has quit IRC | 21:03 | |
| *** salv-orlando has joined #openstack-infra | 21:03 | |
| *** manishg has joined #openstack-infra | 21:03 | |
| *** smarcet has quit IRC | 21:03 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/jeepyb: Care less about github metadata https://review.openstack.org/75691 | 21:04 |
| mordred | clarkb: like that change ^^ | 21:05 |
| openstackgerrit | Mathew Odden proposed a change to openstack-infra/config: Add publish jobs and pipeline for bash8 https://review.openstack.org/92705 | 21:05 |
| mordred | fungi: I agree with your comment on patchset one - and we _do_ have the local repos available | 21:05 |
| *** pdmars has quit IRC | 21:05 | |
| mordred | fungi: (one of the benefits of keeping the local repo cache) | 21:06 |
| mrodden | fungi: i hope that looks sane anyways. thank you for the hand holding, i have no idea how the infra team is so patient :) | 21:06 |
| *** bhuvan has quit IRC | 21:06 | |
| mordred | so in theory we could write a yaml blob or something into a file and shove it into a hidden ref in the repo | 21:06 |
| *** bhuvan_ is now known as bhuvan | 21:06 | |
| mordred | OR | 21:06 |
| mordred | we could keep a local db and write the state of things | 21:06 |
| mordred | and by local db - I mean a trove db of course ;) | 21:06 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Allow core reviewers to abandon and unabandon https://review.openstack.org/91797 | 21:07 |
| mordred | (nah, prolly sqlite would be fine) | 21:07 |
| *** arnaud_ has quit IRC | 21:07 | |
| *** homeless has joined #openstack-infra | 21:07 | |
| fungi | clarkb: see if that's ^ what you were thinkinh | 21:07 |
| fungi | thinking | 21:07 |
| *** manishg has quit IRC | 21:07 | |
| fungi | clarkb: for example https://review.openstack.org/#/c/91797/2/modules/openstack_project/files/gerrit/acls/openstack/tempest.config | 21:08 |
| *** krtaylor has quit IRC | 21:08 | |
| *** manishg has joined #openstack-infra | 21:08 | |
| *** kgriffs is now known as kgriffs|afk | 21:09 | |
| mordred | fungi: that's brilliant. we should land that right now | 21:09 |
| fungi | mordred: well, rebase hell isn't nearly so hellish if you encode the shell script used to generate it into the commit message, so there's no rush on reviewing it | 21:10 |
| *** morganfainberg has quit IRC | 21:11 | |
| *** doug-fish1 has joined #openstack-infra | 21:11 | |
| *** morganfainberg has joined #openstack-infra | 21:11 | |
| *** gokrokve_ has joined #openstack-infra | 21:11 | |
| *** doug-fish has quit IRC | 21:12 | |
| *** manishg has quit IRC | 21:12 | |
| *** phschwartz has quit IRC | 21:13 | |
| *** morganfainberg has quit IRC | 21:13 | |
| fungi | mordred: yeah, my point with the comment on 75691 patchset #1 was merely that we should have a todo comment in that file to remind us it needs doing at some point | 21:13 |
| *** morganfainberg has joined #openstack-infra | 21:13 | |
| *** manishg has joined #openstack-infra | 21:13 | |
| *** morganfainberg has quit IRC | 21:14 | |
| mordred | fungi: nod | 21:14 |
| *** gokrokve has quit IRC | 21:15 | |
| clarkb | fungi: yup | 21:15 |
| clarkb | now hopefully I can diff the patchsets without crying | 21:15 |
| fungi | unrelated (but prompted by that new patchset) i find it somehwhat disturbing that the rebase vote carry-over in new gerrit doesn't seem to leave any comment indicating it's doing so | 21:15 |
| *** rlandy__ has quit IRC | 21:16 | |
| fungi | back in a bit--gotta heat up some dinner | 21:16 |
| *** esker has quit IRC | 21:16 | |
| *** morganfainberg has joined #openstack-infra | 21:17 | |
| *** manishg has quit IRC | 21:17 | |
| *** manishg has joined #openstack-infra | 21:18 | |
| *** dkranz has quit IRC | 21:18 | |
| *** jdurgin has quit IRC | 21:20 | |
| *** thomasem has joined #openstack-infra | 21:20 | |
| *** ominakov has joined #openstack-infra | 21:21 | |
| *** ominakov has quit IRC | 21:21 | |
| *** jdurgin has joined #openstack-infra | 21:22 | |
| *** manishg has quit IRC | 21:22 | |
| mordred | fungi: I was actually just thinking to myself that I liked that | 21:23 |
| *** manishg has joined #openstack-infra | 21:23 | |
| *** lcheng_ has joined #openstack-infra | 21:25 | |
| *** BobBall is now known as BobBall_Away | 21:27 | |
| *** zehicle_at_dell has joined #openstack-infra | 21:27 | |
| *** manishg has quit IRC | 21:27 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add devstack/f20 experimental test https://review.openstack.org/91728 | 21:28 |
| *** manishg has joined #openstack-infra | 21:29 | |
| *** lcheng_ has quit IRC | 21:29 | |
| openstackgerrit | Joshua Harlow proposed a change to openstack/requirements: Add osprofiler to requirements https://review.openstack.org/92708 | 21:33 |
| openstackgerrit | A change was merged to openstack-infra/jeepyb: Care less about github metadata https://review.openstack.org/75691 | 21:33 |
| clarkb | mordred: ^ | 21:34 |
| clarkb | still owkring through fungi's patch | 21:34 |
| clarkb | firefox 29 + gerrit 2.8 hates me | 21:34 |
| jeblair | i'm going to be taking review-dev's database on/offline for testing | 21:36 |
| clarkb | ok | 21:36 |
| jeblair | somehow | 21:36 |
| *** zns has quit IRC | 21:36 | |
| clarkb | iptables? | 21:36 |
| jogo | now that gerrit is upgraded, any time to start setting up specs.o.o? | 21:36 |
| *** chandan_kumar has quit IRC | 21:37 | |
| mordred | clarkb: woot | 21:38 |
| jeblair | jogo: i'm on vacation, but can do so after the summit; clarkb, fungi, or mordred may be able to before | 21:39 |
| clarkb | do we have a plan for that yet? | 21:39 |
| *** manishg has quit IRC | 21:39 | |
| *** thedodd has quit IRC | 21:39 | |
| jeblair | clarkb: i think it's publish them to it like the doc repos | 21:39 |
| *** manishg has joined #openstack-infra | 21:39 | |
| clarkb | the build side is straightforward. More interested in existing thought on hosting | 21:39 |
| jogo | clarkb jeblair: correct | 21:39 |
| clarkb | right but what will specs.o.o be? | 21:39 |
| *** thedodd has joined #openstack-infra | 21:40 | |
| jeblair | so probably a cloud site? | 21:40 |
| jeblair | keeping with the idea of moving all the docs together | 21:40 |
| *** imcsk8 has quit IRC | 21:40 | |
| clarkb | ok | 21:40 |
| *** imcsk8 has joined #openstack-infra | 21:41 | |
| *** weshay has quit IRC | 21:41 | |
| jogo | clarkb: http://lists.openstack.org/pipermail/openstack-dev/2014-March/031251.html for a little context | 21:41 |
| *** otherwiseguy has quit IRC | 21:41 | |
| clarkb | jogo: right, I know the context, but there are technical decisions to be made | 21:42 |
| *** changbl has joined #openstack-infra | 21:42 | |
| jeblair | jogo: you might consider tagging things that involve automated publishing and domain registrations with 'infra' in the future. :) | 21:42 |
| clarkb | jeblair: did you see that I think zuul swift got figured out? | 21:43 |
| jeblair | clarkb: nope | 21:43 |
| *** otherwiseguy has joined #openstack-infra | 21:43 | |
| *** manishg has quit IRC | 21:43 | |
| jogo | jeblair: hehe yeah point taken | 21:44 |
| jogo | clarkb: cool | 21:44 |
| jogo | clarkb: anyway if there is anything I can do to help just let me know | 21:44 |
| *** manishg has joined #openstack-infra | 21:44 | |
| clarkb | jeblair: there were two issues. first we used the wrong tenant name. Should be the numeric account number. But when using that as the tenant name/id rax identity doesn't provide a complete catalog to you and doesn't include object-store | 21:45 |
| *** changbl has quit IRC | 21:45 | |
| clarkb | jeblair: so the fix is to provide no tenant name at all | 21:45 |
| clarkb | then cry about compatible clouds | 21:45 |
| jeblair | clarkb: my head is exploding | 21:45 |
| *** changbl has joined #openstack-infra | 21:45 | |
| *** changbl has quit IRC | 21:45 | |
| *** changbl_ has joined #openstack-infra | 21:45 | |
| *** aconrad has quit IRC | 21:46 | |
| mordred | jeblair: it's pretty much just completely bonkers | 21:46 |
| *** changbl has joined #openstack-infra | 21:46 | |
| *** changbl has quit IRC | 21:46 | |
| clarkb | I updated jheskethcs change to omit the tenant name and tested that by hand with a keystone client instantiated in an interactive python interpreter | 21:47 |
| *** manishg has quit IRC | 21:48 | |
| *** manishg has joined #openstack-infra | 21:49 | |
| *** mriedem has quit IRC | 21:51 | |
| *** changbl_ has quit IRC | 21:52 | |
| *** changbl has joined #openstack-infra | 21:53 | |
| *** manishg has quit IRC | 21:53 | |
| *** manishg has joined #openstack-infra | 21:54 | |
| clarkb | fungi: please let me know when you are back and we can merge the abandon perms change | 21:56 |
| *** rfolco has quit IRC | 21:57 | |
| *** rcarrillocruz has joined #openstack-infra | 21:57 | |
| *** aysyd has quit IRC | 21:58 | |
| *** manishg has quit IRC | 21:58 | |
| *** rcarrill` has quit IRC | 21:58 | |
| *** manishg has joined #openstack-infra | 21:59 | |
| *** gokrokve_ has quit IRC | 22:02 | |
| SergeyLukjanov | jeblair, clarkb, fungi, could you please add me to https://launchpad.net/~openstack-ci-bugs and https://launchpad.net/~openstack-ci-core | 22:03 |
| *** gokrokve has joined #openstack-infra | 22:03 | |
| *** esker has joined #openstack-infra | 22:03 | |
| *** manishg has quit IRC | 22:03 | |
| *** dizquierdo has quit IRC | 22:03 | |
| *** zul has quit IRC | 22:04 | |
| *** manishg has joined #openstack-infra | 22:04 | |
| *** dims_ has joined #openstack-infra | 22:05 | |
| * clarkb learns him an lp | 22:05 | |
| clarkb | SergeyLukjanov: done | 22:06 |
| *** ramashri has quit IRC | 22:06 | |
| *** dims has quit IRC | 22:08 | |
| *** manishg has quit IRC | 22:08 | |
| *** manishg has joined #openstack-infra | 22:09 | |
| jeblair | clarkb, fungi, mordred: if i connect gerrit to a local mysql and stop mysql, zuul gets a database error back from gerrit immediately | 22:09 |
| jeblair | clarkb, fungi, mordred: if i use trove and insert an iptables reject rule in, then ssh commands to gerrit that touch the db sit and wait for quite some time | 22:10 |
| *** freyes has quit IRC | 22:10 | |
| *** thedodd has quit IRC | 22:10 | |
| SergeyLukjanov | clarkb, thanks :) | 22:10 |
| jeblair | clarkb, fungi, mordred: i don't know how long exactly yet (perhaps indefinitely). and perhaps that's what happened today. | 22:10 |
| mordred | jeblair: are we sure that the iptables reject is doing the same thing as a mysql being down/ | 22:11 |
| *** maxbit has quit IRC | 22:11 | |
| jeblair | mordred: not at all | 22:11 |
| jeblair | mordred: but i'm not really sure how to reproduce the trove outage we had | 22:11 |
| mordred | jeblair: this is an area where testing a failure condition is not made easier | 22:11 |
| clarkb | it should be equivalent | 22:12 |
| clarkb | your packets won't make the remote end anymore | 22:12 |
| clarkb | because that end went away | 22:12 |
| clarkb | this is the same if a firewall in the middle drops them or if the remote host dies | 22:12 |
| jeblair | dinner time now | 22:13 |
| clarkb | I suppose the actual error handling might be different though | 22:13 |
| JayF | an iptables reject will send icmp-port-unreachable by default | 22:13 |
| JayF | which is generally the same you'd get for a service not running | 22:13 |
| *** manishg has quit IRC | 22:13 | |
| JayF | is trove using -J REJECT --reject-with some-other-icmp-type | 22:13 |
| *** msabramo has joined #openstack-infra | 22:14 | |
| *** aconrad has joined #openstack-infra | 22:14 | |
| *** manishg has joined #openstack-infra | 22:14 | |
| clarkb | JayF: trove isn't doing anything. The trove instance in the first case was turned off and in jeblair's testing I think the iptables rule was on the gerrit side | 22:14 |
| clarkb | as trove doesn't give you host access iirc | 22:14 |
| JayF | ah, okay | 22:14 |
| * JayF trying to help without enough context | 22:15 | |
| clarkb | JayF: tl;dr trying to debug gerrit behavior when its DB is shutoff | 22:15 |
| clarkb | and not just the DB daemon but the whole server | 22:15 |
| JayF | if the whole server is gone, that'll definately be worse than an iptables -J REJECT | 22:16 |
| clarkb | yeah but how do you reproduce whole server gone without making whole server gone | 22:17 |
| *** arnaud has quit IRC | 22:17 | |
| * clarkb checks if trove lets you shutdown an instance manually | 22:18 | |
| clarkb | pretty sure it doesn't though | 22:18 |
| *** manishg has quit IRC | 22:18 | |
| *** moted has joined #openstack-infra | 22:19 | |
| mordred | clarkb: well ... and i hestitate to say this ... | 22:19 |
| *** moted has left #openstack-infra | 22:19 | |
| *** manishg has joined #openstack-infra | 22:19 | |
| mordred | clarkb: we could spin up a server, run mysql on it, connect review-dev to _that_ then power off the db machine from nova | 22:19 |
| *** thomasem has quit IRC | 22:22 | |
| *** manishg has quit IRC | 22:23 | |
| *** moted has joined #openstack-infra | 22:24 | |
| clarkb | mordred: yup that is what SlickNik and I just settled on | 22:24 |
| *** gondoi is now known as zz_gondoi | 22:24 | |
| clarkb | trove won't expose that to us but we can do it pretty easily outselves | 22:24 |
| clarkb | however, we should make sure we use the same version of mysql as trove | 22:24 |
| clarkb | because it isn't what precise has | 22:24 |
| *** manishg has joined #openstack-infra | 22:24 | |
| *** otherwiseguy has quit IRC | 22:25 | |
| openstackgerrit | Spencer Krum proposed a change to openstack-infra/config: Add puppet-storyboard as a unique project https://review.openstack.org/92231 | 22:26 |
| *** mrodden has quit IRC | 22:27 | |
| *** manishg has quit IRC | 22:28 | |
| fungi | clarkb: back now | 22:29 |
| clarkb | fungi: ok, are you ready to give abandon right to all the people? | 22:29 |
| *** adalbas has quit IRC | 22:29 | |
| *** manishg has joined #openstack-infra | 22:29 | |
| fungi | jeblair: the trove outage was a reboot of the trove instance during planned maintenance, if you missed that. gerrit logs complained about connectivity failures to the remote db | 22:30 |
| anteaya | woohoo my infra-manual check job works: http://docs-draft.openstack.org/75/92475/1/check/gate-infra-manual-docs/74eb911/doc/build/html/ | 22:30 |
| clarkb | fungi: ya trying to wrap our heads around how to properly reproduce that and iptables was used as a substitute ebcause trove doesn't let you shutdown a machine | 22:30 |
| clarkb | fungi: mordred's idea of spinning up a mysql host manually is probably simplest | 22:30 |
| clarkb | we just have to remember to mimic the trove stuff if we do | 22:30 |
| clarkb | iirc its old debian and old mysql | 22:31 |
| nibalizer | krotscheck: im working on it now! | 22:31 |
| clarkb | nibalizer: now with tests? | 22:31 |
| fungi | clarkb: maybe iptables drop instead of reject? | 22:31 |
| mordred | anteaya: woo | 22:31 |
| nibalizer | clarkb: i added puppet-lint and puppet-syntax to both test and gate | 22:31 |
| nibalizer | hopefully thats more or less what you wanted | 22:31 |
| nibalizer | happy to fix it up if needs more | 22:31 |
| clarkb | nibalizer: thats it | 22:31 |
| nibalizer | awesome | 22:31 |
| clarkb | fungi: ya | 22:31 |
| nibalizer | ruby linting the providers/facts etc would be cool to do on all the puppet projects | 22:32 |
| fungi | clarkb: and yeah, i'm happy to babysit the abandon acl mass-update if you approve | 22:32 |
| clarkb | ok | 22:32 |
| nibalizer | but bleh, all the linters want ruby-newerthanprecise | 22:32 |
| fungi | nibalizer: maybe your time will be better spent helping us upgrade to >precise first ;) | 22:32 |
| clarkb | nibalizer: it works fine for us | 22:32 |
| clarkb | like we do that on every change at least twice with precise | 22:33 |
| nibalizer | oh hrm we already ruby lint? | 22:33 |
| *** angdraug has joined #openstack-infra | 22:33 | |
| *** manishg has quit IRC | 22:33 | |
| fungi | nibalizer: puppet lint, not ruby lint | 22:33 |
| clarkb | fungi: approved | 22:33 |
| fungi | i don't think we do any ruby lint jobs | 22:34 |
| clarkb | wait who is writing ruby? | 22:34 |
| anteaya | fungi clarkb url for the acl mass-update? | 22:34 |
| angdraug | gate-nova-pep8 failed with no space on disk, is anyone looking at that yet? | 22:34 |
| nibalizer | clarkb: there is a significant ammount of ruby in openstack-infra/config | 22:34 |
| fungi | anteaya: you'll see gerritbot spew it in here momentarily when it merges | 22:34 |
| *** manishg has joined #openstack-infra | 22:34 | |
| anteaya | angdraug: I think there is a bug open for that | 22:34 |
| clarkb | anteaya: https://review.openstack.org/#/c/91797/ | 22:34 |
| *** hogepodge has quit IRC | 22:34 | |
| anteaya | fungi: oh, thought I could take a peek before it goes in, too late | 22:34 |
| anteaya | clarkb: thanks | 22:35 |
| nibalizer | lol i mean 2 files | 22:35 |
| clarkb | angdraug: anteaya: ya I am pretty sure there is a bug open for that and I checked briefly that it wasn't something silly and easy to fix | 22:35 |
| * fungi is filled of lolz | 22:35 | |
| *** phschwartz has joined #openstack-infra | 22:35 | |
| morganfainberg | clarkb, yay! abandon/unabandon to cores makes me very happy! | 22:35 |
| *** otherwiseguy has joined #openstack-infra | 22:35 | |
| fungi | angdraug: do you have a link to the failure log? | 22:35 |
| clarkb | angdraug: anteaya: but our unittest nodes have tons of disk so I suspect something possibly cloud related | 22:35 |
| clarkb | as we have seen nodes come up with less disk than promised | 22:36 |
| angdraug | http://logs.openstack.org/45/91945/2/check/gate-nova-pep8/bfd47e5/console.html | 22:36 |
| mordred | morganfainberg: == | 22:36 |
| openstackgerrit | A change was merged to openstack-infra/config: Allow core reviewers to abandon and unabandon https://review.openstack.org/91797 | 22:36 |
| mordred | morganfainberg: ++ | 22:36 |
| fungi | and also seen jenkins misinterpret a failure to 'df' as "disk is full, everyone panic" | 22:36 |
| clarkb | nibalizer: krotscheck so for puppet storyboard. Do you want to slurp a repo in and preserve history or do it the cheap way and push once a repo is created? | 22:36 |
| *** moted has quit IRC | 22:36 | |
| anteaya | yes, that was the conclusion last time out of disc came up, I think that was the motivation behind a reshuffling of some loggin files? | 22:36 |
| clarkb | nibalizer: krotscheck one way preserves history the other doesn't | 22:36 |
| anteaya | not sure if I am remembering correctly | 22:37 |
| *** hogepodge has joined #openstack-infra | 22:37 | |
| *** moted has joined #openstack-infra | 22:37 | |
| nibalizer | i like the idea of subtreeing it out | 22:37 |
| angdraug | this one reports IOError, don't think it's jenkins&df | 22:37 |
| krotscheck | clarkb: Mine’s not really something you should slurp in directly, it’ll need to be rewritten as a puppet module rather than an /etc/puppet directory | 22:37 |
| nibalizer | krotscheck: yea we need to merge the puppet you have with the puppet in /config | 22:38 |
| clarkb | nibalizer: you mean git filter branch? | 22:38 |
| nibalizer | into one module | 22:38 |
| nibalizer | clarkb: I probably mean that | 22:38 |
| *** manishg has quit IRC | 22:38 | |
| clarkb | nibalizer: ok, should that change be marked WIP until you have a repo ready for that? | 22:38 |
| fungi | angdraug: oh, hey, it's everyone's favorite, hpcloud az2... a month or so ago we had a similar issue with a bunch of slaves aborting on an ioerror in az2 within a few minutes of one another | 22:38 |
| nibalizer | subtree is proabbly calling filter branch | 22:38 |
| nibalizer | clarkb: sure ill mark it WIP | 22:39 |
| anteaya | *logging files | 22:39 |
| clarkb | fungi: angdraug ya I checked it and the images have tons of disk, I don't think this is related to our images | 22:39 |
| *** hogepodge has quit IRC | 22:39 | |
| clarkb | which left me blaming the provider | 22:39 |
| *** manishg has joined #openstack-infra | 22:39 | |
| fungi | clarkb: it's not the first time we've seen this hit multiple nodes at the same time in that az | 22:39 |
| clarkb | also the node went offline | 22:39 |
| fungi | maybe they're overprovisioned on cow | 22:40 |
| clarkb | which is super suspicious | 22:40 |
| clarkb | nibalizer: thanks | 22:40 |
| clarkb | nibalizer: it is easier to deal with history now than after the project is added | 22:40 |
| fungi | clarkb: well, jenkins will take the node offline if it fails a "health check" (which includes checking available disk space) | 22:40 |
| clarkb | oh | 22:40 |
| clarkb | so pip fails, then jenkins notices and kills the slave? that is amazing | 22:41 |
| fungi | another jenkins optimization which makes no sense for us | 22:41 |
| fungi | because that slave won't run more jobs anyway | 22:41 |
| *** zns has joined #openstack-infra | 22:42 | |
| *** rwsu has quit IRC | 22:42 | |
| *** jgrimm has quit IRC | 22:43 | |
| *** manishg has quit IRC | 22:43 | |
| clarkb | do we have a stance on stackforge projects triggering mirror updates? | 22:43 |
| clarkb | in this case pyghmi wants to trigger mirror updates and is consumed by ironic | 22:44 |
| clarkb | so seems like a good idea | 22:44 |
| clarkb | currently trying to flush the easier reviews out of the queue | 22:44 |
| *** manishg has joined #openstack-infra | 22:44 | |
| fungi | clarkb: yeah, some are openstack dependencies, so it makes sense. others just cargo cult what they see | 22:44 |
| clarkb | ok so in the case of a dep do it otherwise we shouldnt? | 22:45 |
| *** gokrokve has quit IRC | 22:45 | |
| fungi | clarkb: that's what makes sense to me. triggering mirror jobs which won't actually be retrieving the package which got uploaded makes little sense | 22:45 |
| clarkb | ++ | 22:46 |
| fungi | also, thank you for reviewing. i've not been pulling my weight there recently. feel like i'm still catching up | 22:46 |
| mordred | ++ | 22:46 |
| mordred | same here | 22:46 |
| nibalizer | clarkb: sure. laptop died. will mark as wip when i find power | 22:46 |
| clarkb | fungi: well I did mostly declare bankruptcy on last week | 22:47 |
| clarkb | fungi: but ES and e-r kept going :) | 22:47 |
| angdraug | clarkb: so should I just add a recheck comment? or wait? | 22:47 |
| clarkb | angdraug: recheck should be fine | 22:47 |
| clarkb | fyi I will be approving simple things without a second +2 for the next bit | 22:47 |
| mordred | clarkb: ++ | 22:48 |
| *** manishg has quit IRC | 22:48 | |
| clarkb | mordred: 82384 really makes me think we need a bigger consistency hammer when it comes to translations | 22:49 |
| *** manishg has joined #openstack-infra | 22:49 | |
| mattoliverau | Morning | 22:50 |
| *** rcarrill` has joined #openstack-infra | 22:50 | |
| fungi | clarkb: i am in favor | 22:50 |
| mordred | woah | 22:51 |
| *** reed has quit IRC | 22:51 | |
| anteaya | morning mattoliverau | 22:51 |
| mordred | i just +2'd a change in gerrty and it shows as if the "(draft)" user has +2'd the change | 22:51 |
| *** moted has quit IRC | 22:52 | |
| clarkb | mordred: its telling you that its still a local draft. I noticed that too | 22:52 |
| clarkb | mordred: eg it hasn't synced yet | 22:52 |
| *** moted has joined #openstack-infra | 22:52 | |
| clarkb | mordred: I also don't think it changes to you once it has synced without reopening the change | 22:52 |
| mordred | ah | 22:52 |
| mordred | ok | 22:52 |
| *** rcarrillocruz has quit IRC | 22:52 | |
| *** dims_ has quit IRC | 22:53 | |
| clarkb | mordred: it ends up doing the correct thing gerrit side so I htink just a gertty ui bug | 22:53 |
| *** manishg has quit IRC | 22:53 | |
| clarkb | zaro: can you address the comments in 84637 | 22:54 |
| *** mrmartin has joined #openstack-infra | 22:54 | |
| *** manishg has joined #openstack-infra | 22:54 | |
| clarkb | jogo: hacking python33 gate? good to go? | 22:54 |
| *** mrodden has joined #openstack-infra | 22:54 | |
| clarkb | jogo: your comment is ambiguous as it may apply to the change itself or to the result of the change | 22:55 |
| clarkb | meh nevermind you +1'd and there is a woot at the end :) I am approving it | 22:55 |
| *** boris-42 has quit IRC | 22:57 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Fix install_puppet.sh for trusty https://review.openstack.org/90574 | 22:57 |
| *** asettle has joined #openstack-infra | 22:57 | |
| clarkb | hrm 87384, I don't like that. These scripts are in the openstack_proect and don't need to support those features | 22:57 |
| clarkb | mordred: you made them work in a similarish env right? opinions? | 22:57 |
| *** asettle has quit IRC | 22:58 | |
| *** boris-42 has joined #openstack-infra | 22:58 | |
| jogo | clarkb: yup | 22:58 |
| *** alexandra has joined #openstack-infra | 22:58 | |
| jogo | clarkb: good to go | 22:58 |
| jogo | clarkb: py33 is working | 22:58 |
| *** manishg has quit IRC | 22:58 | |
| *** alexandra is now known as asettle | 22:58 | |
| *** jhesketh_ has joined #openstack-infra | 22:59 | |
| *** david-lyle has quit IRC | 22:59 | |
| *** manishg has joined #openstack-infra | 22:59 | |
| *** jhesketh_ is now known as jhesketh | 23:00 | |
| jhesketh | Morning | 23:00 |
| clarkb | mordred: mostly curious if you think the approach in that change is the best approach for everyone since you tackled the problem too | 23:00 |
| *** jdurgin1 has joined #openstack-infra | 23:00 | |
| clarkb | jhesketh: hi there | 23:00 |
| *** jdurgin has quit IRC | 23:00 | |
| anteaya | morning jhesketh | 23:00 |
| jhesketh | clarkb: you wanted me to remind you about the swift credentials? | 23:00 |
| clarkb | jhesketh: I pushed a unrevert of your change | 23:00 |
| *** jdurgin1 has left #openstack-infra | 23:00 | |
| clarkb | jhesketh: yup I think its sorted you should look at ^ | 23:00 |
| jhesketh | oh cool | 23:01 |
| clarkb | jhesketh: double check I gave you author perms on that too | 23:01 |
| mordred | clarkb: clarkb looking | 23:01 |
| clarkb | jhesketh: https://review.openstack.org/#/c/92683/ | 23:01 |
| mordred | clarkb: i honestly think that we should just defer and get the nodepool dib stuff done | 23:01 |
| mordred | since dib already groks proxies | 23:01 |
| openstackgerrit | A change was merged to openstack-infra/config: Add solum to PROJECTS instead of setting https://review.openstack.org/92283 | 23:01 |
| clarkb | jhesketh: long story short the tenant name wasn't correct. It needed to be a numeric account number. When I swtched to the account number I got an incomplete catalog back from rax id service. Workaround seems to be not setting a tenant name at all | 23:02 |
| clarkb | mordred: that works for me, were you going to leave a comment to that effect there? | 23:02 |
| mordred | clarkb: otoh - we could ignore the ugly for a minue | 23:02 |
| mordred | minute | 23:02 |
| mordred | since the proxy support probably doesn't HURT us | 23:02 |
| mordred | and we know we're close to ditching those scripts anyway | 23:03 |
| jhesketh | clarkb: weird.. okay | 23:03 |
| jhesketh | thanks for debugging! | 23:03 |
| clarkb | jhesketh: you should be able to reproduce with swiftclient | 23:03 |
| *** doug-fish1 has left #openstack-infra | 23:03 | |
| mordred | clarkb: you know - so that we're not blocking someone with their issue on a subject we dont' care much about | 23:03 |
| clarkb | jhesketh: http://blog.chmouel.com/2013/09/27/how-to-access-rackspace-cloud-with-latest-swiftclient-novaclient/ has some info | 23:03 |
| *** manishg has quit IRC | 23:03 | |
| *** david-ly_ has joined #openstack-infra | 23:03 | |
| *** mwagner_ has joined #openstack-infra | 23:03 | |
| clarkb | mordred: well to a degree I do care about it | 23:04 |
| clarkb | mordred: as that is code that is currently supported | 23:04 |
| jogo | does git.o.o have https? | 23:04 |
| clarkb | jogo: yes | 23:04 |
| *** manishg has joined #openstack-infra | 23:04 | |
| clarkb | jogo: http, https, and git:// are supported | 23:04 |
| fungi | jogo: tithe paid to the church of the cabforum for a "valid" cert and everything | 23:05 |
| jogo | oh it was just slow on my conenction for a second | 23:05 |
| openstackgerrit | A change was merged to openstack-infra/config: Let infra manage pyghmi releases https://review.openstack.org/74499 | 23:06 |
| *** manishg has quit IRC | 23:08 | |
| mordred | clarkb: how do I get gertty to sync? | 23:08 |
| clarkb | mordred: I think it does it automagically | 23:09 |
| clarkb | mordred: but it never updates the (draft) thing you noticed | 23:09 |
| mordred | clarkb: I've just seen two changes in the list that I've already reviewed elsewhere | 23:09 |
| *** manishg has joined #openstack-infra | 23:09 | |
| clarkb | mordred: that is possibly another bug. It doesn't mark changes as reviewed if they weren't reviewed through gertty | 23:09 |
| *** gokrokve has joined #openstack-infra | 23:10 | |
| clarkb | mordred: you can mark them reviewed from the change list screen | 23:10 |
| *** UtahDave has quit IRC | 23:10 | |
| anteaya | duckduckgo doesn't parse "church of the cabforum" it would like me to read about caborum or ciborium - the last being a sort of cup apparently | 23:10 |
| clarkb | also hrm it hasn't synced my draft yet. I think I subscribe to enough stuff that the syncing is slow | 23:11 |
| clarkb | there it goes | 23:11 |
| *** sdake_ has joined #openstack-infra | 23:11 | |
| mordred | dolphm: on https://review.openstack.org/#/c/91677 - I don't understand how this is an alternative approach to https://review.openstack.org/#/c/91690 ? | 23:13 |
| clarkb | zaro: are you around? | 23:13 |
| clarkb | zaro: I am looking at the gearman in jenkins loglevel change and I don't htink that is correct | 23:13 |
| clarkb | zaro: the change is making the gearman lib log at debug which we really don't want | 23:13 |
| mordred | clarkb: apparently zaro is in palo alto | 23:13 |
| clarkb | zaro: it should make the gearman plugin log at debug level instead | 23:13 |
| clarkb | mordred: o_O | 23:13 |
| *** manishg has quit IRC | 23:13 | |
| clarkb | no wonder he isn't next to me | 23:13 |
| morganfainberg | mordred, i think we decided that it wasn't worth backporting the rally job. but... i'll defer to dolphm's take on that | 23:14 |
| mordred | morganfainberg: it seems like blocking it from running on stable branches is the Right Thing | 23:14 |
| *** manishg has joined #openstack-infra | 23:14 | |
| morganfainberg | mordred, i'm inclined to agree | 23:14 |
| clarkb | ++ | 23:14 |
| clarkb | also keystone master doesn't do python33 either unless something changed | 23:15 |
| mordred | oh - there it is - boris gave the feedback | 23:15 |
| *** mrodden has quit IRC | 23:15 | |
| morganfainberg | clarkb, we actually fixed the check job to pass (iirc) and are working on getting py33 job to ensure we don't regress on what we're testing. | 23:16 |
| morganfainberg | clarkb, but that is master not stable/* | 23:16 |
| clarkb | morganfainberg: you gamed the system then? | 23:16 |
| clarkb | or keystone actually 100% is python3 happy? | 23:16 |
| morganfainberg | clarkb, no can't be due to eventlet | 23:16 |
| morganfainberg | clarkb, we're using it to ensure we don't slide backwards. and we're adding tests as we go | 23:17 |
| *** atiwari has quit IRC | 23:17 | |
| morganfainberg | clarkb, not "gaming" the system, but at least making sure we keep testing anything we can make py33 compatible | 23:17 |
| *** atiwari has joined #openstack-infra | 23:18 | |
| clarkb | I see | 23:18 |
| *** manishg has quit IRC | 23:19 | |
| fungi | anteaya: https://cabforum.org/ | 23:19 |
| clarkb | morganfainberg: did you see my comment on 88477 | 23:19 |
| clarkb | er mordred ^ | 23:19 |
| *** manishg has joined #openstack-infra | 23:20 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add check job for upstream URLs on imported repos https://review.openstack.org/92426 | 23:20 |
| mordred | clarkb: yes - I fixed it in patchset 6 | 23:21 |
| mordred | did I not? | 23:21 |
| mordred | 92028 - looks syntactically correct- but it seems to imply three tox envs that do different things called check, gate and post - which seems very odd to me | 23:22 |
| *** etoews_ has quit IRC | 23:23 | |
| anteaya | fungi: ah | 23:23 |
| *** otherwiseguy has quit IRC | 23:24 | |
| *** manishg has quit IRC | 23:24 | |
| *** manishg has joined #openstack-infra | 23:25 | |
| clarkb | mordred: I don't think you did you still install puppet from trusty on trusty | 23:25 |
| mordred | clarkb: but the puppet.deb gets installed regardless of trusty | 23:25 |
| mordred | which is the thing that installs the puppet sources.list | 23:25 |
| mordred | and if there is no pin, then won't we get puppet from puppetlabs? | 23:26 |
| * clarkb looks again | 23:26 | |
| mordred | (if not, I'm missing something) | 23:26 |
| clarkb | oh right I was also saying keep a pin | 23:26 |
| mordred | but a pin to what/ | 23:26 |
| clarkb | so that we get the same puppet version everywhere without pain | 23:26 |
| mordred | ? | 23:26 |
| clarkb | mordred: current puppet | 23:26 |
| *** dims_ has joined #openstack-infra | 23:27 | |
| mordred | oh. hrm. | 23:27 |
| clarkb | I think even in puppet 3 if you upgrade from say 3.3 to 3.4 there may be incompatibilites | 23:27 |
| clarkb | nibalizer: blkperl Hunner ^ am I wrong? | 23:28 |
| mordred | right. which is kinda why I was thinking now that it's modern enough, just use the distro puppet | 23:28 |
| mordred | since it won't update on us without us knowing | 23:28 |
| mordred | and to support a new distro release we usually have to do puppet work anyway | 23:28 |
| clarkb | mordred: except we can't do that because we have 3 distros now | 23:28 |
| clarkb | ideally once we are on 3 we use the same puppet everywhere | 23:28 |
| *** manishg has quit IRC | 23:29 | |
| mordred | but it means managing a pin for the rest of our lives | 23:29 |
| mordred | if we're doing that - why don't we just install from gems and be done with it | 23:29 |
| mordred | or from git | 23:29 |
| clarkb | because there are packages | 23:29 |
| *** manishg has joined #openstack-infra | 23:30 | |
| clarkb | I guess I don't understand that jump | 23:30 |
| clarkb | we prefer packages and they are available | 23:30 |
| *** dims_ has quit IRC | 23:30 | |
| *** lakshmiS has quit IRC | 23:30 | |
| *** timrc is now known as timrc-afk | 23:30 | |
| mordred | right - but we also prefer not running out own meta-distro if we can | 23:30 |
| *** dims has joined #openstack-infra | 23:30 | |
| mordred | the more we're pinning and the more we're adding apt sources is the more we're taking on responsibility for the interactions of those combinations | 23:30 |
| mordred | and things like security patching | 23:31 |
| mordred | like, do we get security releases from puppetlabs on our puppet 2.x packages? | 23:31 |
| mordred | and/or does our pin affect whether or not we do? | 23:31 |
| clarkb | mordred: you do and it doesn't | 23:31 |
| *** dims has quit IRC | 23:31 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add stable filter for keystone python33 and rally https://review.openstack.org/91690 | 23:32 |
| clarkb | I understand the concern there but it hasn't been an issue | 23:33 |
| clarkb | in general it may be but for that specific repo we have assurances of support and patches and all that | 23:33 |
| clarkb | and they have been met | 23:33 |
| *** manishg has quit IRC | 23:34 | |
| *** dims has joined #openstack-infra | 23:34 | |
| anteaya | moving to gems would mean having someone responsible for tracking gems | 23:34 |
| *** flaper87 is now known as flaper87|afk | 23:34 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Fix install_puppet.sh for trusty https://review.openstack.org/90574 | 23:34 |
| mordred | clarkb: so something like this? ^^ | 23:34 |
| *** manishg has joined #openstack-infra | 23:35 | |
| * mordred still disagrees btw - but it's pretty easy to get rid of pins at some point in the future after we've argued over beer | 23:35 | |
| fungi | never argue over beer. you could upset the beer | 23:36 |
| clarkb | mordred: ya | 23:36 |
| Hunner | clarkb: puppet 3 is supposed to be semver as long as you're not using experimental features such as future parser or strict variables | 23:39 |
| *** manishg has quit IRC | 23:39 | |
| clarkb | Hunner: oh nice. That is a change since 2 right? | 23:39 |
| morganfainberg | mordred, ++ (and i agree about pins) | 23:40 |
| *** manishg has joined #openstack-infra | 23:40 | |
| *** dims has quit IRC | 23:40 | |
| Hunner | clarkb: Yeah, puppet 2.x and previous is not semver. 3.0 onward is | 23:40 |
| Hunner | So if something breaks, you officially get to complain about it ;) | 23:41 |
| fungi | last call to put your key on https://wiki.openstack.org/wiki/OpenPGP_Web_of_Trust/Juno_Summit#Juno_Summit_Key_Signing before i lock it down in 20 minutes so i can generate the checksummed final list | 23:41 |
| *** dims has joined #openstack-infra | 23:41 | |
| anteaya | cabforum.org is validated by godaddy | 23:42 |
| Hunner | clarkb: Newer agents talking to older masters may still try to initialize the connection with stuff that the master doesn't understand, though puppet 3 masters should work with any current or older version 3 agents, iirc | 23:42 |
| clarkb | Hunner: ok that was going to be my next question. so semver applies to the language and the protocol? | 23:42 |
| * anteaya clicks the keysigning wikipage | 23:42 | |
| *** angdraug has left #openstack-infra | 23:43 | |
| Hunner | clarkb: yeah | 23:43 |
| clarkb | mordred so the ping can be 3.* | 23:44 |
| clarkb | s/ping/pin/ | 23:44 |
| *** manishg has quit IRC | 23:44 | |
| *** dims has quit IRC | 23:45 | |
| *** manishg has joined #openstack-infra | 23:45 | |
| mordred | clarkb: kk | 23:45 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Fix install_puppet.sh for trusty https://review.openstack.org/90574 | 23:46 |
| clarkb | mordred: in 91207 there are several classes that aren't specifically used. Is yaml doing magic to walk class hierarchies to make use of those? | 23:46 |
| *** dims has joined #openstack-infra | 23:46 | |
| mordred | clarkb: yes | 23:46 |
| clarkb | PuppetUtilLog, PuppetUtilMetric, PuppetTransactionEvent and so on | 23:46 |
| mordred | there is a metaclass construct at play | 23:46 |
| clarkb | mordred: what made the two that you add_constructor on special? | 23:47 |
| mordred | deriving from yaml.YAMLObject makes it instantiate one of those classes when it finds the tag yaml_tag | 23:47 |
| *** Hefeweizen has joined #openstack-infra | 23:47 | |
| mordred | clarkb: I'm not 100% sure - something about the way they represent in the yaml made them not load properly as metaclass-driven things | 23:47 |
| clarkb | huh ok | 23:47 |
| clarkb | and they inherit from object so they are different | 23:48 |
| mordred | well, I would have had them inherit from YAMLObject if they were registering via the metaclass | 23:48 |
| *** dims has quit IRC | 23:48 | |
| *** hogepodge has joined #openstack-infra | 23:48 | |
| clarkb | ya | 23:48 |
| clarkb | approved | 23:48 |
| mordred | oh - also, the one of them is transforming one fo teh tag anmes | 23:48 |
| mordred | names | 23:48 |
| mordred | because not so much with a variable named "file" in python :) | 23:48 |
| *** dims has joined #openstack-infra | 23:48 | |
| mordred | clarkb: I'm hoping we can use that a stepping stone to grokking what's going on when we run puppet via ssh better | 23:49 |
| clarkb | ++ | 23:49 |
| anteaya | fungi: wikipage edited | 23:49 |
| *** manishg has quit IRC | 23:49 | |
| anteaya | thanks for the reminder | 23:49 |
| *** mrmartin has quit IRC | 23:49 | |
| *** dims has quit IRC | 23:49 | |
| fungi | anteaya: welcome to the machine ;) | 23:49 |
| anteaya | ha ha ha | 23:50 |
| *** manishg has joined #openstack-infra | 23:50 | |
| anteaya | do I need to print more than one copy of that wikipage? | 23:50 |
| *** dims has joined #openstack-infra | 23:50 | |
| *** Alexandra_ has joined #openstack-infra | 23:50 | |
| clarkb | anteaya: no | 23:51 |
| anteaya | great | 23:51 |
| clarkb | anteaya: but wait for the sha1 to go up | 23:51 |
| fungi | anteaya: you need to print no copies of the wiki page. in a few minutes the table on that page will be gone, replaced by a link to a text file version with checksums | 23:51 |
| *** hogepodge_ has joined #openstack-infra | 23:51 | |
| clarkb | ya that | 23:52 |
| mordred | clarkb: my god - my review queue in config is almost not insanely terrible | 23:52 |
| fungi | just working out the final details now in preparation to lock it | 23:52 |
| *** james_li has joined #openstack-infra | 23:52 | |
| *** hogepodge has quit IRC | 23:52 | |
| *** hogepodge_ is now known as hogepodge | 23:52 | |
| clarkb | morganfainberg: for 91738 can we apply that job to keystone, devstack, tempest, and devstack-gate as part of the experimental queue? | 23:53 |
| *** thomasem has joined #openstack-infra | 23:53 | |
| clarkb | morganfainberg: as is that is mostly a noop | 23:53 |
| *** thomasem has quit IRC | 23:53 | |
| *** hogepodge has quit IRC | 23:53 | |
| clarkb | morganfainberg: then we can hit those projects with a hammer until stuff passes | 23:53 |
| morganfainberg | clarkb, ok so how does expirimental work again? sorry i forget | 23:54 |
| *** manishg has quit IRC | 23:54 | |
| clarkb | morganfainberg: as a user you leave a comment of 'check experimental' on a change that needs those jobs run | 23:54 |
| anteaya | fungi: awesome | 23:55 |
| clarkb | morganfainberg: I will get you an example of how to add it to the zuul layout in just a sec | 23:55 |
| morganfainberg | clarkb, as long as we do get it to the point where keystone does gate on it (we had a change recently in keystoneclient that broke mod_wsgi deployments for keystone, and we didn't know) | 23:55 |
| *** david-ly_ has quit IRC | 23:55 | |
| clarkb | morganfainberg: absolutely | 23:55 |
| clarkb | morganfainberg: the nice thing about experimental is we can ease it in without throwing it in and watching it break spectacularly for a week or two as the bugs are ironed out | 23:55 |
| *** manishg has joined #openstack-infra | 23:55 | |
| morganfainberg | clarkb, sure i could be behind that. | 23:55 |
| morganfainberg | clarkb, i _think_ it should just pass as is, but it's fair to make it expirimental first. | 23:56 |
| clarkb | morganfainberg: https://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml#n649 | 23:56 |
| clarkb | morganfainberg: as an alternative you can add it to check as non voting if you think it is close | 23:56 |
| anteaya | is one keyserver favoured over another for publishing my key fingerprint? | 23:56 |
| anteaya | https://en.wikipedia.org/wiki/Key_server_%28cryptographic%29 | 23:57 |
| clarkb | morganfainberg: does devstack gate understand that new flag? if not I think we should make it experimental | 23:57 |
| morganfainberg | clarkb, it should be non-voting in the subsequent review | 23:57 |
| clarkb | oh there are two reviews | 23:57 |
| morganfainberg | clarkb, yes, that one just put the scafolding into the jobs | 23:57 |
| morganfainberg | clarkb, the subsequent one changes layout.taml | 23:57 |
| morganfainberg | yaml* | 23:57 |
| StevenK | anteaya: Key servers will sync between themselves. I tended to use keyserver.ubuntu.com, but usually because I wanted LP to grab it quickly. | 23:57 |
| morganfainberg | clarkb, https://review.openstack.org/#/c/91739/ | 23:57 |
| clarkb | gertty has failed me (it doesn't show parent child change relationships | 23:57 |
| morganfainberg | clarkb, and the APACHE_ENABLED_SERVICES flag does work in devstack now | 23:58 |
| *** atiwari has quit IRC | 23:58 | |
| anteaya | StevenK: k, thanks | 23:58 |
| StevenK | anteaya: pgp.mit.edu should be fine, too | 23:58 |
| clarkb | morganfainberg: what about devstack-gate? | 23:58 |
| morganfainberg | clarkb, https://review.openstack.org/#/c/90812/ | 23:59 |
| clarkb | morganfainberg: 3c4e0bd294ed22c9d41379c23adae78b3f10d676 looks like that did it | 23:59 |
| anteaya | StevenK: *nod | 23:59 |
| morganfainberg | clarkb, yep. | 23:59 |
| clarkb | morganfainberg: sorry for the bother I was afk for a week :) | 23:59 |
| morganfainberg | clarkb, my goal was to do the legwork first then enable the checks :) | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!