| *** krtaylor has joined #openstack-infra | 00:00 | |
| jhesketh | clarkb, fungi, jeblair: important question... when do you guys get into Germany? And do you have any plans on Sunday (such as world cup) | 00:00 |
|---|---|---|
| *** sweston_ has quit IRC | 00:00 | |
| clarkb | jhesketh: 8:40am sunday and I do not have plans for sunday yet but I can check into hotel at 3pm and really want to watch world cup | 00:00 |
| mattoliverau | clarkb: we are in the same hotel as you, and arrive at 7am | 00:01 |
| *** krtaylor has joined #openstack-infra | 00:01 | |
| clarkb | so world cupping should happen, is the game on at ~8pm local time? | 00:01 |
| *** krtaylor has quit IRC | 00:01 | |
| mikal | dolphm: so... you still around? | 00:02 |
| *** krtaylor has joined #openstack-infra | 00:02 | |
| *** krtaylor has quit IRC | 00:02 | |
| *** zzelle__ has quit IRC | 00:03 | |
| fungi | jhesketh: i land at fra noon local time | 00:03 |
| *** krtaylor has joined #openstack-infra | 00:03 | |
| clarkb | it is 2am in frankfurt now so that are utc +2 ? | 00:04 |
| fungi | no particular other than trying to remember enough deutsche to find my way to the maritim darmstadt and check in | 00:04 |
| clarkb | and game is on 5 hours prior to right now | 00:04 |
| pleia2 | clarkb: I think it's +1 | 00:04 |
| clarkb | so 9pm? | 00:04 |
| fungi | clarkb: yeah, cest is +2 right now | 00:04 |
| pleia2 | 9pm | 00:04 |
| fungi | pleia2: they're +1 when it's not summer i believe? | 00:04 |
| jhesketh | clarkb: we get in a 7am or something like that and will be fighting off jetlag | 00:04 |
| pleia2 | fungi: ah, guess you're right :) | 00:05 |
| fungi | central european summer time is on right now | 00:05 |
| clarkb | jhesketh: me too :) | 00:05 |
| clarkb | jhesketh: I am going to try and sleep on plane but that never works | 00:05 |
| jhesketh | clarkb: should we swap numbers in case we want to meet up for world cup watching or touristy things? | 00:05 |
| clarkb | sure | 00:05 |
| jesusaurus | clarkb: have you tried taking some melatonin beforehand? | 00:06 |
| clarkb | jesusaurus: no I haven't | 00:07 |
| *** gyee has quit IRC | 00:07 | |
| dims_ | Anyone seen this? - Bad md5 hash for package http://pypi.openstack.org/packages/source/R/Routes/Routes-1.13.tar.gz#md5=d527b0ab7dd9172b1275a41f97448783 (from http://pypi.openstack.org/simple/Routes/) | 00:08 |
| *** dizquierdo has quit IRC | 00:09 | |
| clarkb | dims_: is it persistent or was it a bit flip? /me grabs package | 00:09 |
| dims_ | grenade run - http://logs.openstack.org/37/105737/4/check/check-grenade-dsvm/a39486a/logs/grenade.sh.txt.gz | 00:09 |
| clarkb | md5sum comes out properly for me | 00:09 |
| clarkb | can we blame that on cosmic rays? | 00:09 |
| jesusaurus | clarkb: if the flight's over 8 hours it might be worth a shot, but it's good to know how youre going to react to it beforehand, a couple mg makes me pass out for like 10 hours | 00:09 |
| *** wenlock has quit IRC | 00:10 | |
| *** Evgeny has quit IRC | 00:10 | |
| clarkb | jesusaurus: huh I may have to try that at some point .not sure I have time for a trial run now | 00:10 |
| *** sarob has joined #openstack-infra | 00:14 | |
| melwitt | hi, does anyone know if the fact that hudson-openstack sometimes doesn't update LP bugs, seems to be when the patch is uploaded "soon" after the LP bug was created, is considered acceptable? I was wondering what to do with https://bugs.launchpad.net/python-novaclient/+bug/1326503 | 00:14 |
| uvirtbot | Launchpad bug 1326503 in python-novaclient "hudson-openstack not working for python-novaclient" [Undecided,New] | 00:14 |
| sdague | clarkb: I told marc at least a few of us would be interested in finding world cup with locals | 00:14 |
| clarkb | sdague: cool | 00:14 |
| davidlenwell | sdague: me me | 00:17 |
| sdague | I assume we're all staying in the darmstadt hotel? | 00:17 |
| davidlenwell | Im in a hotel across the st from that one | 00:17 |
| davidlenwell | "other side of the tracks" | 00:18 |
| *** Evgeny has joined #openstack-infra | 00:18 | |
| *** gangil has quit IRC | 00:24 | |
| *** krtaylor has quit IRC | 00:25 | |
| dims_ | clarkb, +1 to cosmic rays :) | 00:25 |
| sdague | or hp cloud networking :) | 00:25 |
| sdague | you know... I wonder if we get blips ever time neutron changes ports on these boxes for another tenant | 00:26 |
| sdague | because I feel like we get a lot of network blips | 00:26 |
| *** shashankhegde has quit IRC | 00:27 | |
| *** sarob has quit IRC | 00:27 | |
| *** sarob has joined #openstack-infra | 00:27 | |
| *** Evgeny_ has joined #openstack-infra | 00:30 | |
| sc68cal | Hey, I just realized that #openstack-nova is not logged - but many of the other openstack project channels are | 00:30 |
| sc68cal | http://eavesdrop.openstack.org/irclogs/ | 00:30 |
| dims_ | clarkb, one more cosmic ray failure - HTTP error 404 while getting http://pypi.openstack.org/packages/py2.py3/p/python-novaclient/python_novaclient-2.18.0-py2.py3-none-any.whl#md5=5675ce031c5056f6f0de18d1cabd5d31 | 00:31 |
| *** Evgeny has quit IRC | 00:31 | |
| *** sarob has quit IRC | 00:32 | |
| clarkb | dims_: was that on an hpcloud node? we haven oticed hpcloud to rax is spotty at times | 00:33 |
| clarkb | last night there was ~20% packet loss on the node I tested | 00:33 |
| clarkb | sc68cal: correct. the nova channel has elected to not log | 00:33 |
| dims_ | clarkb, saw it here - http://logs.openstack.org/49/103949/6/check/check-grenade-dsvm/999bbb7/console.html | 00:33 |
| clarkb | oh thats a rax node | 00:34 |
| *** sabeen has quit IRC | 00:34 | |
| clarkb | hrm did it 404 because it is looking for a wheel? | 00:34 |
| clarkb | ya that path doesn't look right | 00:34 |
| clarkb | dstufft: ^ is that a bandersnatch fail? | 00:35 |
| dims_ | brb | 00:40 |
| *** otter768 has joined #openstack-infra | 00:42 | |
| *** jroll is now known as brickednick | 00:47 | |
| *** brickednick is now known as jroll | 00:48 | |
| *** melwitt has quit IRC | 00:48 | |
| *** bdpayne has quit IRC | 00:48 | |
| *** mriedem has quit IRC | 00:50 | |
| *** rfolco_ has joined #openstack-infra | 00:54 | |
| *** rfolco has quit IRC | 00:55 | |
| SpamapS | any reason http://pypi.openstack.org/openstack/oslo.vmware/ doesn't have 0.4 yet? | 00:59 |
| SpamapS | global requirements has it | 00:59 |
| SpamapS | global-requirements.txt:oslo.vmware>=0.4 # Apache-2.0 | 00:59 |
| SpamapS | 9a9cb277 (Radoslav Gerganov 2014-07-03 13:48:36 +0300 57)oslo.vmware>=0.4 # Apa | 01:00 |
| *** Evgeny_ has quit IRC | 01:03 | |
| clarkb | SpamapS: that is the dead part of the mirror | 01:04 |
| *** mmaglana has quit IRC | 01:04 | |
| clarkb | SpamapS: http://pypi.openstack.org/simple/oslo.vmware/ is the bandersnatch mirror | 01:05 |
| *** Evgeny has joined #openstack-infra | 01:07 | |
| *** otter768 has quit IRC | 01:10 | |
| *** nati_ueno has quit IRC | 01:15 | |
| *** nati_ueno has joined #openstack-infra | 01:16 | |
| *** salv-orlando has quit IRC | 01:16 | |
| *** Daisy has joined #openstack-infra | 01:18 | |
| dims_ | 404 happened again - HTTP error 404 while getting http://pypi.openstack.org/packages/py2.py3/p/python-novaclient/python_novaclient-2.18.0-py2.py3-none-any.whl#md5=5675ce031c5056f6f0de18d1cabd5d31 (from http://pypi.openstack.org/simple/python-novaclient/) | 01:19 |
| dims_ | in http://logs.openstack.org/32/98132/9/gate/gate-ceilometer-docs/17bfd9b/console.html | 01:19 |
| clarkb | ya so I don't think anything should be pulling from that location | 01:20 |
| clarkb | it actually does not exist | 01:20 |
| clarkb | so it finds http://pypi.openstack.org/simple/python-novaclient/ then decides to get the whl | 01:21 |
| clarkb | which is a link over to an actual 404 | 01:21 |
| clarkb | dstufft: mordred ^ | 01:21 |
| *** nati_ueno has quit IRC | 01:21 | |
| clarkb | oh is this due to the new release? | 01:22 |
| clarkb | I betcha it is | 01:22 |
| dims_ | y probably | 01:22 |
| *** nati_ueno has joined #openstack-infra | 01:22 | |
| clarkb | so either apache isn't server that dir and it exists, or bandersnatch is not making the dir exist | 01:22 |
| clarkb | http://pypi.openstack.org/packages/py2.py3/p/ exists | 01:24 |
| clarkb | so definitely seems like a bandersnatch bug | 01:25 |
| *** tsg has quit IRC | 01:25 | |
| clarkb | possibly that thing where we need to force CDN to serve the package? | 01:25 |
| *** yamahata has quit IRC | 01:25 | |
| clarkb | also bandersnatch should write to simple/foo until the package is in packages/ | 01:25 |
| clarkb | that seems like a no brainer so this must be a bug | 01:26 |
| *** Clabbe has quit IRC | 01:27 | |
| *** mikal has quit IRC | 01:27 | |
| *** ruhe has quit IRC | 01:27 | |
| *** gpocentek has quit IRC | 01:27 | |
| *** tchaypo has quit IRC | 01:27 | |
| *** SergeyLukjanov has quit IRC | 01:27 | |
| *** arun has quit IRC | 01:27 | |
| *** jgriffith has quit IRC | 01:27 | |
| *** garyk has quit IRC | 01:27 | |
| *** zigo has quit IRC | 01:27 | |
| *** nati_ueno has quit IRC | 01:27 | |
| *** ArxCruz has quit IRC | 01:27 | |
| *** pleia2 has quit IRC | 01:27 | |
| *** masayukig has quit IRC | 01:27 | |
| *** mmitchell_ has quit IRC | 01:27 | |
| *** blamar has quit IRC | 01:27 | |
| *** mattymo has quit IRC | 01:27 | |
| *** saper has quit IRC | 01:27 | |
| *** mfink has quit IRC | 01:27 | |
| *** rwsu has quit IRC | 01:27 | |
| *** psedlak has quit IRC | 01:27 | |
| *** asselin has quit IRC | 01:27 | |
| *** Mithrandir has quit IRC | 01:27 | |
| *** sweston has quit IRC | 01:27 | |
| *** mancdaz has quit IRC | 01:27 | |
| *** zz_johnthetubagu has quit IRC | 01:27 | |
| *** uvirtbot has quit IRC | 01:27 | |
| *** krotscheck has quit IRC | 01:27 | |
| *** jamespd has quit IRC | 01:27 | |
| *** davidlenwell has quit IRC | 01:27 | |
| *** _shaps_ has quit IRC | 01:27 | |
| *** rgerganov has quit IRC | 01:27 | |
| *** sandywalsh has quit IRC | 01:27 | |
| *** rfolco_ has quit IRC | 01:27 | |
| *** moted has quit IRC | 01:27 | |
| *** grantbow has quit IRC | 01:27 | |
| *** trinaths has quit IRC | 01:27 | |
| *** dims_ has quit IRC | 01:27 | |
| *** anonitus has quit IRC | 01:27 | |
| *** asettle has quit IRC | 01:27 | |
| *** rakhmerov has quit IRC | 01:27 | |
| *** akuznetsova has quit IRC | 01:27 | |
| *** cody-somerville has quit IRC | 01:27 | |
| *** enikanorov__ has quit IRC | 01:27 | |
| *** dangers_away has quit IRC | 01:27 | |
| *** IAX has quit IRC | 01:27 | |
| *** hemna_ has quit IRC | 01:27 | |
| *** bcrochet has quit IRC | 01:27 | |
| *** timrc-afk has quit IRC | 01:27 | |
| *** annegentle has quit IRC | 01:27 | |
| *** jp_at_hp1 has quit IRC | 01:27 | |
| *** sbadia has quit IRC | 01:27 | |
| *** froek has quit IRC | 01:27 | |
| *** pcrews has quit IRC | 01:27 | |
| *** jd__ has quit IRC | 01:27 | |
| *** nibalizer has quit IRC | 01:27 | |
| *** beagles has quit IRC | 01:27 | |
| *** sdague has quit IRC | 01:27 | |
| *** SpamapS has quit IRC | 01:27 | |
| *** maurosr has quit IRC | 01:27 | |
| *** hdd has quit IRC | 01:27 | |
| *** chmouel has quit IRC | 01:27 | |
| *** zz_dimtruck has quit IRC | 01:27 | |
| *** proffalken has quit IRC | 01:27 | |
| *** sc68cal has quit IRC | 01:27 | |
| *** clarkb has quit IRC | 01:27 | |
| *** devananda has quit IRC | 01:27 | |
| *** jeblair has quit IRC | 01:27 | |
| *** slagle has quit IRC | 01:27 | |
| *** SlickNik has quit IRC | 01:27 | |
| *** Kiall has quit IRC | 01:27 | |
| *** jcooley has quit IRC | 01:27 | |
| *** portante has quit IRC | 01:27 | |
| *** briancline has quit IRC | 01:27 | |
| *** tnurlygayanov has quit IRC | 01:27 | |
| *** armax has quit IRC | 01:27 | |
| *** ZZelle_ has quit IRC | 01:27 | |
| *** chuckC has quit IRC | 01:27 | |
| *** joa has quit IRC | 01:27 | |
| *** Alexei_987 has quit IRC | 01:27 | |
| *** torandu has quit IRC | 01:27 | |
| *** katyafervent has quit IRC | 01:27 | |
| *** nelsnelson has quit IRC | 01:27 | |
| *** gaelL has quit IRC | 01:27 | |
| *** anteaya has quit IRC | 01:27 | |
| *** jogo has quit IRC | 01:27 | |
| *** zul has quit IRC | 01:27 | |
| *** spiffxp_ has quit IRC | 01:27 | |
| *** yamahata__ has quit IRC | 01:27 | |
| *** nithyag__ has quit IRC | 01:27 | |
| *** Daisy has quit IRC | 01:27 | |
| *** tteggel has quit IRC | 01:27 | |
| *** bnemec has quit IRC | 01:27 | |
| *** kashyap has quit IRC | 01:27 | |
| *** markmc has quit IRC | 01:27 | |
| *** kmartin has quit IRC | 01:27 | |
| *** arnaud has quit IRC | 01:27 | |
| *** miqui has quit IRC | 01:27 | |
| *** oanufriev has quit IRC | 01:27 | |
| *** dkehn has quit IRC | 01:27 | |
| *** changbl has quit IRC | 01:27 | |
| *** Shrews has quit IRC | 01:27 | |
| *** jamielennox has quit IRC | 01:27 | |
| *** Ng has quit IRC | 01:27 | |
| *** Hefeweizen has quit IRC | 01:27 | |
| *** msuriar has quit IRC | 01:27 | |
| *** jraim has quit IRC | 01:27 | |
| *** vponomaryov has quit IRC | 01:27 | |
| *** bradm has quit IRC | 01:27 | |
| *** thingee has quit IRC | 01:27 | |
| *** BobBall has quit IRC | 01:27 | |
| *** gothicmindfood has quit IRC | 01:27 | |
| *** cindyo has quit IRC | 01:27 | |
| *** zhiyan_ has quit IRC | 01:27 | |
| *** ciypro|afk has quit IRC | 01:27 | |
| *** eharney has quit IRC | 01:27 | |
| *** harlowja has quit IRC | 01:27 | |
| *** isviridov has quit IRC | 01:27 | |
| *** rcarrillocruz has quit IRC | 01:27 | |
| *** openstackgerrit has quit IRC | 01:27 | |
| *** tcammann has quit IRC | 01:27 | |
| *** mtreinish has quit IRC | 01:27 | |
| *** vladan has quit IRC | 01:27 | |
| *** gema has quit IRC | 01:27 | |
| *** gilliard_ has quit IRC | 01:27 | |
| *** plars has quit IRC | 01:27 | |
| *** kevinbenton has quit IRC | 01:27 | |
| *** mugsie has quit IRC | 01:27 | |
| *** dkliban_afk has quit IRC | 01:27 | |
| *** spiffxp has quit IRC | 01:27 | |
| *** mfisch has quit IRC | 01:27 | |
| *** jhesketh has quit IRC | 01:27 | |
| *** Vek has quit IRC | 01:27 | |
| *** ekarlso has quit IRC | 01:27 | |
| *** charz has quit IRC | 01:27 | |
| *** gmurphy has quit IRC | 01:27 | |
| *** s0nea has quit IRC | 01:27 | |
| *** morganfainberg_Z has quit IRC | 01:27 | |
| *** paul-- has quit IRC | 01:27 | |
| *** boris-42 has quit IRC | 01:27 | |
| *** Evgeny has quit IRC | 01:27 | |
| *** reed has quit IRC | 01:27 | |
| *** dmitryme has quit IRC | 01:27 | |
| *** NikitaKonovalov has quit IRC | 01:27 | |
| *** oomichi has quit IRC | 01:27 | |
| *** yfried__ has quit IRC | 01:27 | |
| *** x1b2j has quit IRC | 01:27 | |
| *** loquacities has quit IRC | 01:27 | |
| *** dtroyer has quit IRC | 01:27 | |
| *** antonym has quit IRC | 01:27 | |
| *** pabelanger has quit IRC | 01:27 | |
| *** dougwig has quit IRC | 01:27 | |
| *** Alex_Gaynor has quit IRC | 01:27 | |
| *** serverascode has quit IRC | 01:27 | |
| *** wendar has quit IRC | 01:27 | |
| *** nikhil___ has quit IRC | 01:27 | |
| *** jroll has quit IRC | 01:27 | |
| *** pfallenop has quit IRC | 01:27 | |
| *** gnuoy has quit IRC | 01:27 | |
| *** mrda has quit IRC | 01:27 | |
| *** sileht has quit IRC | 01:27 | |
| *** AaronGr has quit IRC | 01:27 | |
| *** Daviey has quit IRC | 01:27 | |
| *** EntropyWorks has quit IRC | 01:27 | |
| *** vishy has quit IRC | 01:27 | |
| *** d34dh0r53 has quit IRC | 01:27 | |
| *** esmute has quit IRC | 01:27 | |
| *** ptoohill has quit IRC | 01:27 | |
| *** Hunner has quit IRC | 01:27 | |
| *** mrodden has quit IRC | 01:27 | |
| *** bodepd has quit IRC | 01:27 | |
| *** d0ugal has quit IRC | 01:27 | |
| *** phschwartz has quit IRC | 01:27 | |
| *** timfreund has quit IRC | 01:27 | |
| *** dhellmann has quit IRC | 01:27 | |
| *** lyxus has quit IRC | 01:27 | |
| *** dosaboy has quit IRC | 01:27 | |
| *** med_ has quit IRC | 01:27 | |
| *** JoshNang has quit IRC | 01:27 | |
| *** Guest56682 has quit IRC | 01:27 | |
| *** mnaser has quit IRC | 01:27 | |
| *** sulochan_ has quit IRC | 01:27 | |
| *** vipul has quit IRC | 01:27 | |
| *** praneshp has quit IRC | 01:27 | |
| *** Ryan_Lane has quit IRC | 01:27 | |
| *** penguinRaider has quit IRC | 01:27 | |
| *** YorikSar has quit IRC | 01:27 | |
| *** mkerrin has quit IRC | 01:27 | |
| *** greghaynes has quit IRC | 01:27 | |
| *** NobodyCam has quit IRC | 01:27 | |
| *** GheRivero has quit IRC | 01:27 | |
| *** eglynn-office has quit IRC | 01:27 | |
| *** rickerc has quit IRC | 01:27 | |
| *** cdub has quit IRC | 01:27 | |
| *** fifieldt has quit IRC | 01:27 | |
| *** jerryz has quit IRC | 01:27 | |
| *** marcoemorais has quit IRC | 01:27 | |
| *** hughsaunders has quit IRC | 01:27 | |
| *** jgrimm has quit IRC | 01:27 | |
| *** skraynev has quit IRC | 01:27 | |
| *** therve has quit IRC | 01:27 | |
| *** msabramo1 has quit IRC | 01:27 | |
| *** primeministerp has quit IRC | 01:27 | |
| *** ildikov has quit IRC | 01:27 | |
| *** flaviof_zzz has quit IRC | 01:27 | |
| *** jpeeler has quit IRC | 01:27 | |
| *** roaet_ has quit IRC | 01:27 | |
| *** mgagne has quit IRC | 01:27 | |
| *** Adri2000 has quit IRC | 01:27 | |
| *** BadCub_ has quit IRC | 01:27 | |
| *** zz_gondoi has quit IRC | 01:27 | |
| *** tristanC has quit IRC | 01:27 | |
| *** fungi has quit IRC | 01:27 | |
| *** jbryce has quit IRC | 01:27 | |
| *** dencaval has quit IRC | 01:27 | |
| *** enikanorov_ has quit IRC | 01:27 | |
| *** michchap has quit IRC | 01:27 | |
| *** fabo has quit IRC | 01:27 | |
| *** dtantsur has quit IRC | 01:27 | |
| *** afazekas has quit IRC | 01:27 | |
| *** zaro has quit IRC | 01:27 | |
| *** mika has quit IRC | 01:27 | |
| *** radez_g0n3 has quit IRC | 01:27 | |
| *** ttx has quit IRC | 01:27 | |
| *** StevenK has quit IRC | 01:27 | |
| *** simonmcc has quit IRC | 01:27 | |
| *** comstud has quit IRC | 01:27 | |
| *** alaski has quit IRC | 01:27 | |
| *** cyeoh has quit IRC | 01:27 | |
| *** russellb has quit IRC | 01:27 | |
| *** cyli has quit IRC | 01:27 | |
| *** dolphm has quit IRC | 01:27 | |
| *** stevebaker has quit IRC | 01:27 | |
| *** adam_g has quit IRC | 01:27 | |
| *** plomakin_ has quit IRC | 01:27 | |
| *** dguerri has quit IRC | 01:27 | |
| *** notmyname has quit IRC | 01:27 | |
| *** flaper87|afk has quit IRC | 01:27 | |
| *** soren has quit IRC | 01:27 | |
| *** rossella_s has quit IRC | 01:27 | |
| *** ChanServ has quit IRC | 01:27 | |
| *** rfolco_ has joined #openstack-infra | 01:30 | |
| *** jp_at_hp1 has joined #openstack-infra | 01:30 | |
| *** moted has joined #openstack-infra | 01:30 | |
| *** grantbow has joined #openstack-infra | 01:30 | |
| *** trinaths has joined #openstack-infra | 01:30 | |
| *** sbadia has joined #openstack-infra | 01:30 | |
| *** froek has joined #openstack-infra | 01:30 | |
| *** dims_ has joined #openstack-infra | 01:30 | |
| *** pcrews has joined #openstack-infra | 01:30 | |
| *** anonitus has joined #openstack-infra | 01:30 | |
| *** asettle has joined #openstack-infra | 01:30 | |
| *** beagles has joined #openstack-infra | 01:30 | |
| *** rakhmerov has joined #openstack-infra | 01:30 | |
| *** akuznetsova has joined #openstack-infra | 01:30 | |
| *** jd__ has joined #openstack-infra | 01:30 | |
| *** nibalizer has joined #openstack-infra | 01:30 | |
| *** cody-somerville has joined #openstack-infra | 01:30 | |
| *** enikanorov__ has joined #openstack-infra | 01:30 | |
| *** sdague has joined #openstack-infra | 01:30 | |
| *** SpamapS has joined #openstack-infra | 01:30 | |
| *** maurosr has joined #openstack-infra | 01:30 | |
| *** dangers_away has joined #openstack-infra | 01:30 | |
| *** IAX has joined #openstack-infra | 01:30 | |
| *** hemna_ has joined #openstack-infra | 01:30 | |
| *** bcrochet has joined #openstack-infra | 01:30 | |
| *** timrc-afk has joined #openstack-infra | 01:30 | |
| *** annegentle has joined #openstack-infra | 01:30 | |
| *** tnurlygayanov has joined #openstack-infra | 01:30 | |
| *** hdd has joined #openstack-infra | 01:30 | |
| *** chmouel has joined #openstack-infra | 01:30 | |
| *** zz_dimtruck has joined #openstack-infra | 01:30 | |
| *** proffalken has joined #openstack-infra | 01:30 | |
| *** sc68cal has joined #openstack-infra | 01:30 | |
| *** clarkb has joined #openstack-infra | 01:30 | |
| *** devananda has joined #openstack-infra | 01:30 | |
| *** jeblair has joined #openstack-infra | 01:30 | |
| *** slagle has joined #openstack-infra | 01:30 | |
| *** SlickNik has joined #openstack-infra | 01:30 | |
| *** Kiall has joined #openstack-infra | 01:30 | |
| *** jcooley has joined #openstack-infra | 01:30 | |
| *** portante has joined #openstack-infra | 01:30 | |
| *** briancline has joined #openstack-infra | 01:30 | |
| clarkb | https://bitbucket.org/pypa/bandersnatch/src/5885ad40fe476e10ee55d26dc7001b545a420715/src/bandersnatch/package.py?at=default#cl-69 | 01:30 |
| clarkb | I wonder if we synced the tarball properly and when it synced the simple page it wrote both tarball and wheel despite the wheel failing | 01:32 |
| clarkb | yup I think that is it | 01:33 |
| clarkb | woo | 01:33 |
| *** moted has quit IRC | 01:33 | |
| * clarkb files a bug | 01:33 | |
| *** grantbow has quit IRC | 01:34 | |
| *** cody-somerville has quit IRC | 01:34 | |
| *** grantbow_ has joined #openstack-infra | 01:34 | |
| *** krtaylor has joined #openstack-infra | 01:34 | |
| dims_ | nice work clarkb :) | 01:35 |
| clarkb | but first let me fix the missing whl | 01:36 |
| clarkb | otherwise all the tests will fail | 01:36 |
| clarkb | dims_: that whl url should not 404 now. can you test really quickly? | 01:40 |
| dims_ | y i can reach that url | 01:41 |
| clarkb | cool | 01:41 |
| clarkb | I am writing a very detailed bug :) | 01:42 |
| *** nosnos has joined #openstack-infra | 01:45 | |
| clarkb | dstufft: mordred dims_ https://bitbucket.org/pypa/bandersnatch/issue/47/simple-index-synced-for-package-after | 01:47 |
| *** zz_dimtruck is now known as dimtruck | 01:49 | |
| *** fifieldt has joined #openstack-infra | 01:58 | |
| *** cdub has joined #openstack-infra | 01:58 | |
| *** rickerc has joined #openstack-infra | 01:58 | |
| *** eglynn-office has joined #openstack-infra | 01:58 | |
| *** GheRivero has joined #openstack-infra | 01:58 | |
| *** NobodyCam has joined #openstack-infra | 01:58 | |
| *** greghaynes has joined #openstack-infra | 01:58 | |
| *** mkerrin has joined #openstack-infra | 01:58 | |
| *** YorikSar has joined #openstack-infra | 01:58 | |
| *** penguinRaider has joined #openstack-infra | 01:58 | |
| *** Ryan_Lane has joined #openstack-infra | 01:58 | |
| *** vipul has joined #openstack-infra | 01:58 | |
| *** nati_ueno has joined #openstack-infra | 01:58 | |
| *** comstud has joined #openstack-infra | 01:58 | |
| *** simonmcc has joined #openstack-infra | 01:58 | |
| *** StevenK has joined #openstack-infra | 01:58 | |
| *** ttx has joined #openstack-infra | 01:58 | |
| *** radez_g0n3 has joined #openstack-infra | 01:58 | |
| *** mika has joined #openstack-infra | 01:58 | |
| *** zaro has joined #openstack-infra | 01:58 | |
| *** afazekas has joined #openstack-infra | 01:58 | |
| *** dtantsur has joined #openstack-infra | 01:58 | |
| *** fabo has joined #openstack-infra | 01:58 | |
| *** michchap has joined #openstack-infra | 01:58 | |
| *** enikanorov_ has joined #openstack-infra | 01:58 | |
| *** fungi has joined #openstack-infra | 01:58 | |
| *** jbryce has joined #openstack-infra | 01:58 | |
| *** tristanC has joined #openstack-infra | 01:58 | |
| *** BadCub_ has joined #openstack-infra | 01:58 | |
| *** Adri2000 has joined #openstack-infra | 01:58 | |
| *** mgagne has joined #openstack-infra | 01:58 | |
| *** roaet_ has joined #openstack-infra | 01:58 | |
| *** zz_gondoi has joined #openstack-infra | 01:58 | |
| *** dencaval has joined #openstack-infra | 01:58 | |
| *** jpeeler has joined #openstack-infra | 01:58 | |
| *** flaviof_zzz has joined #openstack-infra | 01:58 | |
| *** ildikov has joined #openstack-infra | 01:58 | |
| *** primeministerp has joined #openstack-infra | 01:58 | |
| *** msabramo1 has joined #openstack-infra | 01:58 | |
| *** therve has joined #openstack-infra | 01:58 | |
| *** skraynev has joined #openstack-infra | 01:58 | |
| *** jgrimm has joined #openstack-infra | 01:58 | |
| *** hughsaunders has joined #openstack-infra | 01:58 | |
| *** cody-somerville has joined #openstack-infra | 01:58 | |
| *** adam_g has joined #openstack-infra | 01:58 | |
| *** rossella_s has joined #openstack-infra | 01:58 | |
| *** soren has joined #openstack-infra | 01:58 | |
| *** flaper87|afk has joined #openstack-infra | 01:58 | |
| *** notmyname has joined #openstack-infra | 01:58 | |
| *** dguerri has joined #openstack-infra | 01:58 | |
| *** plomakin_ has joined #openstack-infra | 01:58 | |
| *** stevebaker has joined #openstack-infra | 01:58 | |
| *** dolphm has joined #openstack-infra | 01:58 | |
| *** cyli has joined #openstack-infra | 01:58 | |
| *** russellb has joined #openstack-infra | 01:58 | |
| *** cyeoh has joined #openstack-infra | 01:58 | |
| *** ciypro|afk has joined #openstack-infra | 01:58 | |
| *** cindyo has joined #openstack-infra | 01:58 | |
| *** zhiyan_ has joined #openstack-infra | 01:58 | |
| *** gothicmindfood has joined #openstack-infra | 01:58 | |
| *** thingee has joined #openstack-infra | 01:58 | |
| *** bradm has joined #openstack-infra | 01:58 | |
| *** vponomaryov has joined #openstack-infra | 01:58 | |
| *** jraim has joined #openstack-infra | 01:58 | |
| *** msuriar has joined #openstack-infra | 01:58 | |
| *** Hefeweizen has joined #openstack-infra | 01:58 | |
| *** Ng has joined #openstack-infra | 01:58 | |
| *** BobBall has joined #openstack-infra | 01:58 | |
| *** jamielennox has joined #openstack-infra | 01:58 | |
| *** Shrews has joined #openstack-infra | 01:58 | |
| *** changbl has joined #openstack-infra | 01:58 | |
| *** dkehn has joined #openstack-infra | 01:58 | |
| *** miqui has joined #openstack-infra | 01:58 | |
| *** oanufriev has joined #openstack-infra | 01:58 | |
| *** arnaud has joined #openstack-infra | 01:58 | |
| *** kmartin has joined #openstack-infra | 01:58 | |
| *** markmc has joined #openstack-infra | 01:58 | |
| *** kashyap has joined #openstack-infra | 01:58 | |
| *** tteggel has joined #openstack-infra | 01:58 | |
| *** bnemec has joined #openstack-infra | 01:58 | |
| *** Daisy has joined #openstack-infra | 01:58 | |
| *** s0nea has joined #openstack-infra | 01:58 | |
| *** gmurphy has joined #openstack-infra | 01:58 | |
| *** ekarlso has joined #openstack-infra | 01:58 | |
| *** Vek has joined #openstack-infra | 01:58 | |
| *** jhesketh has joined #openstack-infra | 01:58 | |
| *** mfisch has joined #openstack-infra | 01:58 | |
| *** spiffxp has joined #openstack-infra | 01:58 | |
| *** dkliban_afk has joined #openstack-infra | 01:58 | |
| *** charz has joined #openstack-infra | 01:58 | |
| *** mugsie has joined #openstack-infra | 01:58 | |
| *** kevinbenton has joined #openstack-infra | 01:58 | |
| *** plars has joined #openstack-infra | 01:58 | |
| *** gilliard_ has joined #openstack-infra | 01:58 | |
| *** gema has joined #openstack-infra | 01:58 | |
| *** vladan has joined #openstack-infra | 01:58 | |
| *** mtreinish has joined #openstack-infra | 01:58 | |
| *** tcammann has joined #openstack-infra | 01:58 | |
| *** openstackgerrit has joined #openstack-infra | 01:58 | |
| *** rcarrillocruz has joined #openstack-infra | 01:58 | |
| *** isviridov has joined #openstack-infra | 01:58 | |
| *** eharney has joined #openstack-infra | 01:58 | |
| *** dstufft|laptop has joined #openstack-infra | 01:58 | |
| *** armax has joined #openstack-infra | 01:58 | |
| *** ZZelle_ has joined #openstack-infra | 01:58 | |
| *** chuckC has joined #openstack-infra | 01:58 | |
| *** joa has joined #openstack-infra | 01:58 | |
| *** Alexei_987 has joined #openstack-infra | 01:58 | |
| *** torandu has joined #openstack-infra | 01:58 | |
| *** katyafervent has joined #openstack-infra | 01:58 | |
| *** nelsnelson has joined #openstack-infra | 01:58 | |
| *** gaelL has joined #openstack-infra | 01:58 | |
| *** anteaya has joined #openstack-infra | 01:58 | |
| *** jogo has joined #openstack-infra | 01:58 | |
| *** zul has joined #openstack-infra | 01:58 | |
| *** 92AABGH0Y has joined #openstack-infra | 01:58 | |
| *** yamahata__ has joined #openstack-infra | 01:58 | |
| *** nithyag__ has joined #openstack-infra | 01:58 | |
| *** armax has quit IRC | 01:58 | |
| *** Clabbe has joined #openstack-infra | 02:03 | |
| *** mikal has joined #openstack-infra | 02:03 | |
| *** ruhe has joined #openstack-infra | 02:03 | |
| *** gpocentek has joined #openstack-infra | 02:03 | |
| *** tchaypo has joined #openstack-infra | 02:03 | |
| *** paul-- has joined #openstack-infra | 02:03 | |
| *** morganfainberg_Z has joined #openstack-infra | 02:03 | |
| *** jyuso has joined #openstack-infra | 02:03 | |
| *** SergeyLukjanov has joined #openstack-infra | 02:04 | |
| *** arun has joined #openstack-infra | 02:04 | |
| *** jgriffith has joined #openstack-infra | 02:04 | |
| *** garyk has joined #openstack-infra | 02:04 | |
| *** zigo has joined #openstack-infra | 02:04 | |
| *** jp_at_hp1 has quit IRC | 02:05 | |
| *** mrda has joined #openstack-infra | 02:05 | |
| *** Evgeny has joined #openstack-infra | 02:05 | |
| *** reed has joined #openstack-infra | 02:05 | |
| *** dmitryme has joined #openstack-infra | 02:05 | |
| *** NikitaKonovalov has joined #openstack-infra | 02:05 | |
| *** oomichi has joined #openstack-infra | 02:05 | |
| *** EntropyWorks has joined #openstack-infra | 02:05 | |
| *** yfried__ has joined #openstack-infra | 02:05 | |
| *** x1b2j has joined #openstack-infra | 02:05 | |
| *** loquacities has joined #openstack-infra | 02:05 | |
| *** dtroyer has joined #openstack-infra | 02:05 | |
| *** antonym has joined #openstack-infra | 02:05 | |
| *** pabelanger has joined #openstack-infra | 02:05 | |
| *** Alex_Gaynor has joined #openstack-infra | 02:05 | |
| *** dougwig has joined #openstack-infra | 02:05 | |
| *** serverascode has joined #openstack-infra | 02:05 | |
| *** nikhil___ has joined #openstack-infra | 02:05 | |
| *** wendar has joined #openstack-infra | 02:05 | |
| *** jroll has joined #openstack-infra | 02:05 | |
| *** pfallenop has joined #openstack-infra | 02:05 | |
| *** gnuoy has joined #openstack-infra | 02:05 | |
| *** d34dh0r53 has joined #openstack-infra | 02:05 | |
| *** sileht has joined #openstack-infra | 02:05 | |
| *** AaronGr has joined #openstack-infra | 02:05 | |
| *** Daviey has joined #openstack-infra | 02:05 | |
| *** vishy has joined #openstack-infra | 02:05 | |
| *** esmute has joined #openstack-infra | 02:05 | |
| *** ptoohill has joined #openstack-infra | 02:05 | |
| *** Hunner has joined #openstack-infra | 02:05 | |
| *** mrodden has joined #openstack-infra | 02:05 | |
| *** bodepd has joined #openstack-infra | 02:05 | |
| *** d0ugal has joined #openstack-infra | 02:05 | |
| *** JoshNang has joined #openstack-infra | 02:05 | |
| *** phschwartz has joined #openstack-infra | 02:05 | |
| *** timfreund has joined #openstack-infra | 02:05 | |
| *** dhellmann has joined #openstack-infra | 02:05 | |
| *** lyxus has joined #openstack-infra | 02:05 | |
| *** dosaboy has joined #openstack-infra | 02:05 | |
| *** med_ has joined #openstack-infra | 02:05 | |
| *** mnaser has joined #openstack-infra | 02:05 | |
| *** Guest56682 has joined #openstack-infra | 02:05 | |
| *** sulochan_ has joined #openstack-infra | 02:05 | |
| *** ArxCruz has joined #openstack-infra | 02:06 | |
| *** pleia2 has joined #openstack-infra | 02:06 | |
| *** mmitchell_ has joined #openstack-infra | 02:06 | |
| *** masayukig has joined #openstack-infra | 02:06 | |
| *** mattymo has joined #openstack-infra | 02:06 | |
| *** saper has joined #openstack-infra | 02:06 | |
| *** dougwig has quit IRC | 02:06 | |
| *** dougwig has joined #openstack-infra | 02:06 | |
| *** dougwig has quit IRC | 02:07 | |
| *** dougwig has joined #openstack-infra | 02:07 | |
| *** sballe has joined #openstack-infra | 02:07 | |
| *** baohua has joined #openstack-infra | 02:08 | |
| *** mfink has joined #openstack-infra | 02:08 | |
| *** rwsu has joined #openstack-infra | 02:08 | |
| *** psedlak has joined #openstack-infra | 02:08 | |
| *** asselin has joined #openstack-infra | 02:08 | |
| *** Mithrandir has joined #openstack-infra | 02:08 | |
| *** sweston has joined #openstack-infra | 02:08 | |
| *** mancdaz has joined #openstack-infra | 02:08 | |
| *** zz_johnthetubagu has joined #openstack-infra | 02:08 | |
| *** uvirtbot has joined #openstack-infra | 02:08 | |
| *** krotscheck has joined #openstack-infra | 02:08 | |
| *** jamespd has joined #openstack-infra | 02:08 | |
| *** davidlenwell has joined #openstack-infra | 02:08 | |
| *** _shaps_ has joined #openstack-infra | 02:08 | |
| *** rgerganov has joined #openstack-infra | 02:08 | |
| *** sandywalsh has joined #openstack-infra | 02:08 | |
| *** jerryz_ has joined #openstack-infra | 02:10 | |
| *** jerryz_ has quit IRC | 02:10 | |
| *** jerryz_ has joined #openstack-infra | 02:10 | |
| *** Evgeny has quit IRC | 02:11 | |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Adding query for broken rax mirror https://review.openstack.org/106196 | 02:11 |
| *** rickerc has quit IRC | 02:11 | |
| *** Ryan_Lane has quit IRC | 02:12 | |
| dims_ | clarkb, still around? | 02:12 |
| *** jhesketh__ has joined #openstack-infra | 02:12 | |
| clarkb | dims_: sure | 02:13 |
| dims_ | logstash query "E: Failed to fetch http://mirror.rackspace.com/" - we hit that a lot today | 02:13 |
| dims_ | example - http://logs.openstack.org/46/105746/3/check/check-tempest-dsvm-full/4597139/logs/devstacklog.txt.gz | 02:14 |
| openstackgerrit | A change was merged to openstack/requirements: Add new keystone projects to projects.txt https://review.openstack.org/103375 | 02:14 |
| clarkb | dims_: don't we already have a wuery for failed apt mirrors? | 02:14 |
| clarkb | dims_: I think its a bit more generic to catch hpcloud too | 02:14 |
| clarkb | 1286818.yaml maybe? | 02:14 |
| dims_ | bug 1251117 is for rax mirror issues, so i am adding a query for that one | 02:15 |
| uvirtbot | Launchpad bug 1251117 in openstack-ci "devstack-vm gate failure due to apt-get download failure (dup-of: 1286818)" [Low,Triaged] https://launchpad.net/bugs/1251117 | 02:15 |
| uvirtbot | Launchpad bug 1286818 in openstack-ci "Ubuntu mirror periodically inconsistent causing gate build failures" [Low,Triaged] https://launchpad.net/bugs/1286818 | 02:15 |
| dims_ | ah someone dup-ed it | 02:15 |
| *** jhesketh__ has quit IRC | 02:16 | |
| *** jhesketh__ has joined #openstack-infra | 02:16 | |
| *** arnaud has quit IRC | 02:17 | |
| *** ChanServ has joined #openstack-infra | 02:20 | |
| *** dickson.freenode.net sets mode: +o ChanServ | 02:20 | |
| *** arnaud has joined #openstack-infra | 02:21 | |
| *** otter768 has joined #openstack-infra | 02:21 | |
| *** arnaud__ has joined #openstack-infra | 02:21 | |
| *** jhesketh has quit IRC | 02:21 | |
| *** jhesketh__ is now known as jhesketh | 02:22 | |
| *** signed8bit has joined #openstack-infra | 02:23 | |
| *** harlowja has joined #openstack-infra | 02:23 | |
| *** yamahata has joined #openstack-infra | 02:23 | |
| *** rickerc has joined #openstack-infra | 02:24 | |
| *** bdpayne has joined #openstack-infra | 02:26 | |
| *** dimtruck is now known as zz_dimtruck | 02:42 | |
| *** amcrn has joined #openstack-infra | 02:43 | |
| *** dstanek_zzz has joined #openstack-infra | 02:43 | |
| *** shardy has joined #openstack-infra | 02:44 | |
| *** Azher has joined #openstack-infra | 02:44 | |
| *** boris-42 has joined #openstack-infra | 02:49 | |
| *** dims_ has quit IRC | 02:52 | |
| *** Daisy has quit IRC | 02:54 | |
| *** tsg has joined #openstack-infra | 02:59 | |
| *** sballe has quit IRC | 03:09 | |
| *** rickerc has quit IRC | 03:11 | |
| *** wenlock has joined #openstack-infra | 03:12 | |
| *** nati_ueno has quit IRC | 03:21 | |
| *** trinaths has quit IRC | 03:23 | |
| *** pcm_ has joined #openstack-infra | 03:26 | |
| *** oomichi has quit IRC | 03:36 | |
| *** arnaud has quit IRC | 03:37 | |
| *** boris-42 has quit IRC | 03:38 | |
| *** arnaud__ has quit IRC | 03:40 | |
| *** boris-42 has joined #openstack-infra | 03:41 | |
| *** nosnos has quit IRC | 03:43 | |
| *** marun has joined #openstack-infra | 03:43 | |
| *** chuckC has quit IRC | 03:45 | |
| *** dims_ has joined #openstack-infra | 03:48 | |
| *** chandankumar has joined #openstack-infra | 03:50 | |
| *** dims_ has quit IRC | 03:53 | |
| *** HenryG has joined #openstack-infra | 03:56 | |
| *** signed8bit has quit IRC | 03:59 | |
| *** nosnos has joined #openstack-infra | 04:09 | |
| *** annegent_ has joined #openstack-infra | 04:10 | |
| *** harlowja is now known as harlowja_away | 04:16 | |
| *** otter768 has quit IRC | 04:16 | |
| *** gangil has joined #openstack-infra | 04:19 | |
| *** annegen__ has joined #openstack-infra | 04:22 | |
| *** annegent_ has quit IRC | 04:23 | |
| *** pcm_ has quit IRC | 04:23 | |
| *** adrian_otto has joined #openstack-infra | 04:27 | |
| *** rfolco_ has quit IRC | 04:38 | |
| *** markwash has joined #openstack-infra | 04:39 | |
| *** cody-somerville has quit IRC | 04:40 | |
| *** cody-somerville has joined #openstack-infra | 04:41 | |
| mikal | jhesketh: le ping? | 04:41 |
| jhesketh | mikal: pong | 04:41 |
| mikal | The TH comment from 6:38am on https://review.openstack.org/#/c/97946/ confuses me | 04:41 |
| mikal | At least one of the log links is to localhost | 04:42 |
| jhesketh | mikal: ah that's because user001 actually has missing uuid's | 04:44 |
| jhesketh | it's what I was fixing yesterday, | 04:44 |
| jhesketh | you must have hit a bad node that can't handle it | 04:44 |
| jhesketh | mikal: so we also might need to consider removing those null rows from our datasets so that once it merges it passes | 04:44 |
| mikal | So, that doesn't explain the bad log URL though | 04:45 |
| jhesketh | mikal: right, turbo-hipster was broken where the migration exited early | 04:46 |
| jhesketh | mikal: I pushed a fix for it yesterday, but that doesn't seem to have made it onto the worker nodes :-( | 04:46 |
| mikal | So in cases where the migration crashes, we return a bad log URL? | 04:46 |
| mikal | Ahhh, ok | 04:46 |
| jhesketh | sadly, yes | 04:46 |
| mikal | So it is fixed, just perhaps not pushed to nodepool yet? | 04:46 |
| jhesketh | well I regenerated the images so it should be there, but apparently not | 04:46 |
| jhesketh | I'll poke nodepool some more | 04:47 |
| mikal | So, in the case of this change, I am not sure we should change the dataset without verifying with the original donor that the change wont hurt them | 04:47 |
| mikal | Thanks | 04:47 |
| jhesketh | yes we should chat to them, but we've also talked to Matt about the impact of this change | 04:47 |
| jhesketh | and I think it's accepted as a necessary evil | 04:48 |
| clarkb | are you guys in the organ trade now? | 04:48 |
| jhesketh | what really needs to happen is to determine how the donor got the database into that state.. as the expectation was that this is just a fail measure | 04:48 |
| *** chandankumar has quit IRC | 04:48 | |
| *** annegen__ has quit IRC | 04:49 | |
| *** dims_ has joined #openstack-infra | 04:49 | |
| *** moted has joined #openstack-infra | 04:50 | |
| mikal | clarkb: pardon? | 04:50 |
| *** annegent_ has joined #openstack-infra | 04:50 | |
| clarkb | mikal: all this talk of donors :) | 04:50 |
| mikal | jhesketh: I don't think the donor will know... THat dataset has been in prod for years, and has been through a bunch of upgrades | 04:51 |
| jhesketh | oh yeah, I don't expect it to be realistic | 04:51 |
| mikal | jhesketh: that's kind of the point though, they're one of our most loyal users | 04:51 |
| *** dims_ has quit IRC | 04:54 | |
| *** annegent_ has quit IRC | 04:55 | |
| *** ArxCruz has quit IRC | 04:56 | |
| *** mkoderer has joined #openstack-infra | 04:58 | |
| *** bdpayne has quit IRC | 04:59 | |
| *** ildikov has quit IRC | 04:59 | |
| *** bdpayne has joined #openstack-infra | 05:00 | |
| *** chandankumar has joined #openstack-infra | 05:01 | |
| *** wenlock has quit IRC | 05:07 | |
| *** moted has quit IRC | 05:08 | |
| *** praneshp has joined #openstack-infra | 05:08 | |
| *** moted has joined #openstack-infra | 05:10 | |
| *** praneshp_ has joined #openstack-infra | 05:10 | |
| *** dims_ has joined #openstack-infra | 05:12 | |
| *** arnaud has joined #openstack-infra | 05:13 | |
| *** praneshp has quit IRC | 05:14 | |
| *** praneshp_ is now known as praneshp | 05:14 | |
| *** emagana has joined #openstack-infra | 05:14 | |
| zaro | clarkb: did you ever test the gerrit delete project plugin on review-dev? | 05:15 |
| clarkb | zaro: no | 05:15 |
| clarkb | zaro: we should never delete projects and the process that fungi drew up for deleting that one project because of failed rename worked fine | 05:16 |
| *** k4n0 has joined #openstack-infra | 05:17 | |
| *** dims_ has quit IRC | 05:17 | |
| *** annegent_ has joined #openstack-infra | 05:19 | |
| zaro | clarkb: didn't you add the gerrit-delete-plugin to our build? what's that for? | 05:20 |
| clarkb | zaro: we were going to use it | 05:21 |
| clarkb | zaro: to remove that one project that that didn't get renamed properly | 05:21 |
| clarkb | but then figured out it was better to do it directly | 05:21 |
| zaro | ahh ok. just wondering if it ever worked on 2.8 | 05:22 |
| *** obondarev has joined #openstack-infra | 05:23 | |
| *** annegent_ has quit IRC | 05:24 | |
| *** emagana has quit IRC | 05:25 | |
| *** emagana has joined #openstack-infra | 05:26 | |
| clarkb | I don't think it was tested | 05:26 |
| *** Guest58876 has joined #openstack-infra | 05:27 | |
| *** HenryG has quit IRC | 05:28 | |
| *** emagana has quit IRC | 05:30 | |
| *** bdpayne has quit IRC | 05:31 | |
| *** trinaths has joined #openstack-infra | 05:33 | |
| *** obondarev has quit IRC | 05:35 | |
| *** bdpayne has joined #openstack-infra | 05:36 | |
| *** bdpayne has quit IRC | 05:36 | |
| *** bdpayne has joined #openstack-infra | 05:37 | |
| *** amitpp has joined #openstack-infra | 05:46 | |
| *** harlowja_at_home has joined #openstack-infra | 05:55 | |
| *** afazekas is now known as __afazekas | 06:02 | |
| *** mmaglana has joined #openstack-infra | 06:03 | |
| *** morganfainberg_Z is now known as morganfainberg | 06:03 | |
| *** nosnos has quit IRC | 06:08 | |
| *** harlowja_at_home has quit IRC | 06:09 | |
| *** shashankhegde has joined #openstack-infra | 06:10 | |
| openstackgerrit | afazekas proposed a change to openstack-infra/config: Add 2 node experimental job to d-g https://review.openstack.org/105534 | 06:10 |
| *** ildikov has joined #openstack-infra | 06:11 | |
| *** emagana has joined #openstack-infra | 06:11 | |
| *** dims_ has joined #openstack-infra | 06:12 | |
| *** adrian_otto has quit IRC | 06:13 | |
| *** Guest58876 has quit IRC | 06:13 | |
| *** cody-somerville has quit IRC | 06:14 | |
| *** emagana has quit IRC | 06:16 | |
| *** dstanek_zzz is now known as dstanek | 06:16 | |
| *** dims_ has quit IRC | 06:17 | |
| *** pcrews has quit IRC | 06:19 | |
| *** annegent_ has joined #openstack-infra | 06:20 | |
| *** asettle has quit IRC | 06:20 | |
| *** morganfainberg is now known as morganfainberg_Z | 06:21 | |
| *** morganfainberg_Z is now known as morganfainberg | 06:23 | |
| *** reed has quit IRC | 06:24 | |
| *** annegent_ has quit IRC | 06:25 | |
| *** zigo has quit IRC | 06:26 | |
| openstackgerrit | Andreas Jaeger proposed a change to openstack-infra/config: Add glance-upstream-translation-update https://review.openstack.org/106282 | 06:28 |
| *** Ajaeger has joined #openstack-infra | 06:28 | |
| *** cody-somerville has joined #openstack-infra | 06:28 | |
| Ajaeger | Good morning, | 06:30 |
| clarkb | o/ | 06:30 |
| *** shashankhegde has quit IRC | 06:31 | |
| clarkb | mordred please see bandersnatch bug. I am too tired to respond this late at night | 06:31 |
| Ajaeger | 10hours ago https://review.openstack.org/98238 was merged, it added new translation jobs, e.g. one for barbican. | 06:32 |
| Ajaeger | But none of this was run as part of the daily translation import. The jobs exist e.g. https://jenkins.openstack.org/view/All/job/barbican-propose-translation-update/ | 06:32 |
| Ajaeger | Does it take longer for Zuul to update? | 06:33 |
| Ajaeger | clarkb: good night ;) | 06:33 |
| clarkb | no zuul should have updated but I am not much help now | 06:34 |
| *** SumitNaiksatam has joined #openstack-infra | 06:34 | |
| *** zigo has joined #openstack-infra | 06:34 | |
| Ajaeger | clarkb: ok, I'll ask again once people are awake | 06:36 |
| *** bdpayne has quit IRC | 06:39 | |
| *** afazekas has joined #openstack-infra | 06:39 | |
| *** gangil has quit IRC | 06:45 | |
| *** Ryan_Lane has joined #openstack-infra | 06:45 | |
| *** moted has quit IRC | 06:46 | |
| *** rcarrill` has joined #openstack-infra | 06:50 | |
| *** rcarrillocruz has quit IRC | 06:52 | |
| *** Ryan_Lane has quit IRC | 06:57 | |
| *** jamespage_ has joined #openstack-infra | 07:00 | |
| *** dstufft|laptop has quit IRC | 07:04 | |
| *** praneshp_ has joined #openstack-infra | 07:06 | |
| *** praneshp has quit IRC | 07:07 | |
| *** praneshp_ is now known as praneshp | 07:07 | |
| *** jamespage_ has quit IRC | 07:07 | |
| *** otherwiseguy has joined #openstack-infra | 07:09 | |
| *** mfink has quit IRC | 07:11 | |
| *** doude has joined #openstack-infra | 07:11 | |
| *** mfink has joined #openstack-infra | 07:12 | |
| *** arnaud has quit IRC | 07:12 | |
| *** emagana has joined #openstack-infra | 07:12 | |
| *** dims_ has joined #openstack-infra | 07:13 | |
| *** ihrachyshka has joined #openstack-infra | 07:13 | |
| *** flaper87|afk is now known as flaper87 | 07:13 | |
| *** emagana has quit IRC | 07:16 | |
| *** tkelsey_ has joined #openstack-infra | 07:17 | |
| *** jcoufal-mobile has joined #openstack-infra | 07:17 | |
| *** marun has quit IRC | 07:18 | |
| *** dims_ has quit IRC | 07:18 | |
| *** jcoufal has joined #openstack-infra | 07:19 | |
| openstackgerrit | A change was merged to openstack/requirements: Add requests-mock package to global requirements https://review.openstack.org/104067 | 07:20 |
| *** annegent_ has joined #openstack-infra | 07:20 | |
| *** salv-orlando has joined #openstack-infra | 07:21 | |
| *** luqas has joined #openstack-infra | 07:24 | |
| *** dstanek is now known as dstanek_zzz | 07:25 | |
| *** annegent_ has quit IRC | 07:25 | |
| mattoliverau | I'm calling it a day, long flight to Germany tomorrow, see those who are going to the mid-cycle in person soon :) | 07:26 |
| *** jgallard has joined #openstack-infra | 07:27 | |
| *** andreykurilin_ has joined #openstack-infra | 07:29 | |
| *** otherwiseguy has quit IRC | 07:29 | |
| *** Longgeek has joined #openstack-infra | 07:30 | |
| *** luqas has quit IRC | 07:30 | |
| *** _nadya_ has joined #openstack-infra | 07:31 | |
| *** luqas has joined #openstack-infra | 07:32 | |
| *** jgallard has quit IRC | 07:32 | |
| *** jgallard has joined #openstack-infra | 07:33 | |
| *** ihrachyshka has quit IRC | 07:33 | |
| Ajaeger | mattoliverau: have a good trip! | 07:35 |
| *** morgabra has quit IRC | 07:41 | |
| *** jogo has quit IRC | 07:41 | |
| *** jogo has joined #openstack-infra | 07:41 | |
| *** openstack has joined #openstack-infra | 07:42 | |
| *** morgabra has joined #openstack-infra | 07:42 | |
| *** jlibosva has joined #openstack-infra | 07:51 | |
| *** mkoderer has quit IRC | 07:52 | |
| *** Longgeek_ has joined #openstack-infra | 07:52 | |
| *** Longgeek_ has quit IRC | 07:52 | |
| *** Longgeek_ has joined #openstack-infra | 07:53 | |
| *** Longgeek has quit IRC | 07:56 | |
| *** zhiyan_ is now known as zhiyan | 07:57 | |
| *** mrda is now known as mrda-weekend | 07:58 | |
| *** nelsnels_ has joined #openstack-infra | 08:00 | |
| *** nelsnelson has quit IRC | 08:03 | |
| *** Longgeek_ has quit IRC | 08:04 | |
| *** cody-somerville has quit IRC | 08:05 | |
| *** xianghui has joined #openstack-infra | 08:05 | |
| *** pblaho has joined #openstack-infra | 08:10 | |
| *** cody-somerville has joined #openstack-infra | 08:10 | |
| *** yaguang has joined #openstack-infra | 08:12 | |
| *** emagana has joined #openstack-infra | 08:13 | |
| *** dims_ has joined #openstack-infra | 08:14 | |
| *** hashar has joined #openstack-infra | 08:14 | |
| *** dstanek_zzz is now known as dstanek | 08:16 | |
| *** emagana has quit IRC | 08:17 | |
| *** jistr has joined #openstack-infra | 08:17 | |
| *** Guest58876 has joined #openstack-infra | 08:17 | |
| *** dims_ has quit IRC | 08:18 | |
| *** mkoderer has joined #openstack-infra | 08:19 | |
| *** AaronGr has quit IRC | 08:21 | |
| *** tsg has joined #openstack-infra | 08:21 | |
| *** AaronGr has joined #openstack-infra | 08:22 | |
| *** luqas has quit IRC | 08:24 | |
| *** e0ne has joined #openstack-infra | 08:24 | |
| *** praneshp_ has joined #openstack-infra | 08:25 | |
| *** luqas has joined #openstack-infra | 08:25 | |
| *** praneshp has quit IRC | 08:26 | |
| *** praneshp_ is now known as praneshp | 08:26 | |
| *** dstanek is now known as dstanek_zzz | 08:26 | |
| *** luqas has quit IRC | 08:27 | |
| *** dims_ has joined #openstack-infra | 08:28 | |
| *** luqas has joined #openstack-infra | 08:29 | |
| *** luqas has quit IRC | 08:30 | |
| *** ihrachyshka has joined #openstack-infra | 08:31 | |
| *** _nadya_ has quit IRC | 08:31 | |
| *** ildikov has quit IRC | 08:32 | |
| *** IvanBerezovskiy has joined #openstack-infra | 08:33 | |
| *** dims_ has quit IRC | 08:33 | |
| *** tsg has quit IRC | 08:34 | |
| *** andreykurilin_ has quit IRC | 08:34 | |
| openstackgerrit | Sergey Skripnick proposed a change to openstack-infra/devstack-gate: Add option to enable profiling https://review.openstack.org/104123 | 08:34 |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Adding subsription model and DB API https://review.openstack.org/106037 | 08:38 |
| *** hashar_ has joined #openstack-infra | 08:42 | |
| *** maxbit has joined #openstack-infra | 08:42 | |
| *** yfried__ has quit IRC | 08:42 | |
| *** cody-somerville has quit IRC | 08:43 | |
| *** hashar has quit IRC | 08:43 | |
| *** e0ne has quit IRC | 08:48 | |
| *** jp_at_hp has joined #openstack-infra | 08:55 | |
| *** katyafervent is now known as katyafervent_awa | 08:56 | |
| *** derekh__ has joined #openstack-infra | 08:56 | |
| *** hashar_ is now known as hashar | 08:58 | |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/infra-specs: StoryBoard scalable search https://review.openstack.org/106313 | 08:59 |
| *** tkelsey_ has quit IRC | 09:05 | |
| *** amcrn has quit IRC | 09:08 | |
| *** dizquierdo has joined #openstack-infra | 09:12 | |
| *** luqas has joined #openstack-infra | 09:16 | |
| openstackgerrit | Antoine Musso proposed a change to stackforge/python-jenkins: Yield HTTPError reason on open error https://review.openstack.org/106314 | 09:18 |
| *** pelix has joined #openstack-infra | 09:19 | |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/infra-specs: StoryBoard search spec https://review.openstack.org/97254 | 09:20 |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/infra-specs: StoryBoard scalable search https://review.openstack.org/106313 | 09:20 |
| joa | yay, back for a new day of fighting zuul and jenkins o/ | 09:20 |
| *** zz_johnthetubagu is now known as johnthetubaguy | 09:23 | |
| *** katyafervent_awa is now known as katyafervent | 09:25 | |
| hashar | joa: what is wrong with it ? :D | 09:25 |
| joa | hashar: I'm bad with it, seemingly. | 09:26 |
| hashar | lovely operator http://www.poneytelecom.eu | 09:27 |
| hashar | :D | 09:27 |
| joa | can't manage to setup a working CI | 09:27 |
| hashar | I can probably guide you | 09:27 |
| joa | hashar: hehe, it's part of the online.net company I think ? | 09:27 |
| hashar | I have set it up for Wikimedia | 09:27 |
| joa | oh good; so first of all which method did you use ? Jaypipes's scripts ? | 09:27 |
| hashar | I did it way before Jay wrote the tutorials for third parties | 09:28 |
| joa | okay, manually then or did you setup your own scripts ? | 09:28 |
| hashar | via puppet :-D | 09:29 |
| hashar | a config management system | 09:29 |
| *** dims_ has joined #openstack-infra | 09:29 | |
| hashar | what is blocking you ? | 09:29 |
| hashar | I install directly from source | 09:29 |
| hashar | with dependencies provided by Debian packages | 09:29 |
| joa | Well, I got zuul to be seemingly properly configured (debug log talking about events triggers and all), but it didn't link properly with jenkins | 09:29 |
| hashar | but pip would work | 09:29 |
| hashar | Zuul should have an embedded Gearman server | 09:30 |
| joa | yup it has; jenkins was saying "can connect" | 09:30 |
| hashar | that listens on port 4370 and probably only on 127.0.0.1 by default | 09:30 |
| hashar | then Jenkins should have the Gearman Pluginwhich has a way to check whether it is properly connected | 09:31 |
| hashar | then Jenkins, which becomes a Gearman worker, will register its jobs as Gearman function in Zuul gearman embedded server | 09:31 |
| joa | yup, and that check said "ok"; just no jobs appearing on the jenkins | 09:31 |
| hashar | and you can list the registered functions using a hack | 09:31 |
| hashar | https://www.mediawiki.org/wiki/Zuul#Debugging | 09:31 |
| hashar | echo status|nc -q 3 localhost 4730 | 09:31 |
| hashar | that should list the registered functions | 09:32 |
| hashar | (-q 3 is a 3 seconds timeout) | 09:32 |
| hashar | note that Zuul spawn the Gearman embedded server by forking | 09:33 |
| hashar | so a ps f should yield something like: | 09:33 |
| joa | okay, so something is actually broken there. Got nothing out of the nc. | 09:33 |
| hashar | /usr/bin/python /usr/local/bin/zuul-server | 09:33 |
| hashar | \_ /usr/bin/python /usr/local/bin/zuul-server | 09:33 |
| hashar | /usr/bin/python /usr/local/bin/zuul-merger -c /etc/zuul/zuul-merger.conf | 09:33 |
| joa | urgh; right.. The zuul server doesnt' start properly with service utilities.. | 09:34 |
| hashar | (zuul merger is an independent process. Cant remember offhand how it talks with Zuul) | 09:34 |
| hashar | ah | 09:34 |
| *** dims_ has quit IRC | 09:34 | |
| hashar | I copy pasted their init script | 09:34 |
| joa | Okay | 09:34 |
| joa | launching manually works | 09:34 |
| joa | I loathe that init script. | 09:34 |
| hashar | https://github.com/openstack-infra/config/blob/master/modules/zuul/files/zuul.init | 09:35 |
| hashar | and https://github.com/openstack-infra/config/blob/master/modules/zuul/files/zuul-merger.init | 09:35 |
| hashar | you will need the default files as well | 09:35 |
| joa | well, I don't even know how jaypipe's scripts install zuul :D Lemme check | 09:35 |
| hashar | though it is only used to set the statsd host https://github.com/openstack-infra/config/blob/master/modules/zuul/templates/zuul.default.erb | 09:35 |
| hashar | the poor man "init script don't start" debug tool: strace -f -s1024 /etc/init.d/zuul start | 09:36 |
| hashar | that will dumps system calls | 09:36 |
| hashar | and sometime show you the error message | 09:36 |
| hashar | there must be a smarter way to do it though :D | 09:36 |
| *** zhiyan_ has joined #openstack-infra | 09:38 | |
| joa | looking at strace's output right now | 09:38 |
| *** pblaho is now known as pblaho-lunch | 09:40 | |
| joa | let's grep write(2 :D | 09:40 |
| joa | and I seem to get some tracebacks | 09:41 |
| *** zhiyan_ has quit IRC | 09:41 | |
| *** zhiyan_ has joined #openstack-infra | 09:41 | |
| *** zhiyan has left #openstack-infra | 09:44 | |
| joa | oh a nice hidden perm denial on the logging... | 09:44 |
| *** zhiyan_ has quit IRC | 09:45 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add python-client installation to the mistral job https://review.openstack.org/105394 | 09:45 |
| joa | well, maybe because I started it as root earlier. | 09:45 |
| *** zhiyan_ has joined #openstack-infra | 09:45 | |
| *** zhiyan_ has quit IRC | 09:46 | |
| *** zhiyan_ has joined #openstack-infra | 09:46 | |
| *** zhiyan_ has quit IRC | 09:47 | |
| hashar | joa: ah possibly :D | 09:48 |
| joa | okay | 09:48 |
| hashar | maybe the init script can be ^made to not redirect stderr to /dev/null | 09:48 |
| joa | now it seems to work. | 09:49 |
| hashar | welllll done! | 09:49 |
| joa | ahh how I hate permission management :D | 09:49 |
| joa | happily, I'm not a security guy o/ | 09:49 |
| hashar | are you paranoid? | 09:49 |
| joa | Sooo, in the nc output, any function worth mentionning ? | 09:49 |
| joa | not that much. I tend to see security as a matter of trust and care about privacy | 09:49 |
| hashar | then you are not a security guy :D | 09:50 |
| joa | if you don't want any risk, don't do anything :D | 09:50 |
| hashar | anyway | 09:50 |
| *** zhiyan_ has joined #openstack-infra | 09:50 | |
| hashar | the nc output yields the function registered in Gearman server | 09:50 |
| hashar | they more or less bind to Jenkins jobs | 09:50 |
| hashar | if there is stuff there, that means Jenkins registered properly | 09:50 |
| hashar | and Zuul should be able to trigger the jobs | 09:50 |
| hashar | now you have to try :D | 09:50 |
| joa | well, I have merger:merge, merger:update, zuul:get_running_jobs, stop:$IP, set_description:$IP, zuul:enqueue, zuul:promote and another one linked to a jobI manually defined in earlier attempts (didnt remove it yet) | 09:52 |
| joa | how should I see them in the jenkins UI ? I currently only see the manually defined job | 09:52 |
| *** zhiyan_ has quit IRC | 09:52 | |
| joa | (gearman plugin is okay) | 09:53 |
| *** zhiyan_ has joined #openstack-infra | 09:54 | |
| joa | hashar: is the statsd required for zuul+jenkins to work properly ? | 09:56 |
| hashar | not at all | 09:56 |
| hashar | it rely on the python module statsd . Zuul attempts to load it but skip gracefully if it is not around | 09:57 |
| hashar | and even if the module is present, you need STATSD_HOST to be set | 09:57 |
| hashar | so by default, no statsd emitted | 09:57 |
| hashar | totally optional | 09:57 |
| hashar | entirely optional | 09:57 |
| *** denis_makogon has joined #openstack-infra | 09:57 | |
| hashar | joa: some functions registered in Zuul Gearman are internal to zuul | 09:58 |
| hashar | the merger:* comes from zuul-merger | 09:58 |
| hashar | zuul:* comes from Zuul scheduler (i.e. zuul-server ) | 09:58 |
| *** oanufriev has quit IRC | 09:58 | |
| hashar | set_description is for Zuul to update the job description in Jenkins | 09:58 |
| hashar | an example at https://integration.wikimedia.org/ci/job/mediawiki-core-extensions-integration/71/ | 09:59 |
| *** Longgeek has joined #openstack-infra | 09:59 | |
| hashar | riggered by change: 119940,12 | 09:59 |
| hashar | Branch: master | 09:59 |
| hashar | Pipeline: experimental | 09:59 |
| hashar | All builds for this change... | 09:59 |
| hashar | and so on | 09:59 |
| *** Evgeny has joined #openstack-infra | 09:59 | |
| hashar | joa: if you create a new job in Jenkins, it should be registered to Geraman server and you will see it in the debug command | 09:59 |
| hashar | (hopefully) | 10:00 |
| joa | ok so I should create jobs after that. I kind of thought it would be automagical and pop jobs.. Naivety willl kill me | 10:00 |
| *** zhiyan_ has quit IRC | 10:01 | |
| *** zhiyan has joined #openstack-infra | 10:01 | |
| joa | Is there any parameter to set specifically for zuul or .. ? | 10:02 |
| *** dstanek_zzz is now known as dstanek | 10:02 | |
| *** baohua has quit IRC | 10:02 | |
| hashar | no parameters needed | 10:02 |
| hashar | that is done internally | 10:02 |
| joa | ok | 10:02 |
| joa | So I just set name, description and that's about it ? | 10:03 |
| hashar | the Zuul scheduler will trigger a Gearman function with a bunch of parameters such as ZUUL_URL ZUUL_CHANGE etc | 10:03 |
| hashar | then Jenkins grab the job and all the parameters and set them as parameters to the build | 10:03 |
| joa | ok | 10:03 |
| hashar | which are then exposed as env variable | 10:03 |
| hashar | you can try it with a dummy change | 10:03 |
| hashar | dump-zuul-env | 10:03 |
| hashar | that would just: export|fgrep ZUUL_ | 10:03 |
| *** zhiyan has quit IRC | 10:04 | |
| *** baohua has joined #openstack-infra | 10:04 | |
| *** zhiyan has joined #openstack-infra | 10:04 | |
| joa | how do I trigger that dummy change ? | 10:05 |
| *** praneshp has quit IRC | 10:05 | |
| hashar | depends on your zuul layout file I guess :D | 10:05 |
| hashar | something useful is to have a Zuul pipeline to react on comment posted in Gerrit | 10:06 |
| joa | I took jaypipes's for that | 10:06 |
| *** ArxCruz has joined #openstack-infra | 10:06 | |
| joa | it contains the proper events to react to | 10:06 |
| hashar | https://github.com/openstack-infra/config/blob/master/modules/openstack_project/files/zuul/layout.yaml#L17 | 10:07 |
| joa | so changes added and the comments with the right syntax | 10:07 |
| *** Evgeny has quit IRC | 10:07 | |
| hashar | The pipeline "check" react to Gerrit event "comment-added" | 10:07 |
| hashar | and further match the comment to be (?i)^(Patch Set [0-9]+:)?( [\w\\+-]*)*(\n\n)?\s*recheck(( (?:bug|lp)[\s#:]*(\d+))|( no bug))\s*$ | 10:07 |
| joa | (and removes all the nitty gritty stuff from the too big layout of openstack infra) | 10:07 |
| hashar | so that let folks comment "recheck no bug" on a change | 10:07 |
| hashar | and that act exactly like if a new patchset got pushed in gerrit | 10:07 |
| joa | yup, I understood that part. Now I guess I have to check my zuul configuration again | 10:08 |
| hashar | i guess | 10:08 |
| hashar | Zuul server debug log might help | 10:08 |
| *** skolekonov has joined #openstack-infra | 10:08 | |
| hashar | joa: wikimedia layout is at http://git.wikimedia.org/blob/integration%2Fzuul-config.git/master/layout.yaml | 10:08 |
| hashar | it is a bit messy though | 10:09 |
| hashar | coffee break brb | 10:09 |
| joa | does the debug log say wether it could associate a trigger and a job? | 10:09 |
| hashar | maybe :D can't remember | 10:09 |
| joa | okay | 10:09 |
| hashar | I haven't looked at the debug log for quite a long time | 10:09 |
| joa | I see triggers but nothing about the associated job. | 10:09 |
| joa | Also, is it an issue if the zuul.log contains lot of warnings for unmanaged projects ? | 10:10 |
| *** Evgeny has joined #openstack-infra | 10:12 | |
| joa | So I only have the check pipeline in my layout; with only one project openstack-dev/sandbox (for which check starts a noop-check-communication) | 10:12 |
| *** morganfainberg is now known as morganfainberg_Z | 10:13 | |
| *** jgallard has quit IRC | 10:14 | |
| *** emagana has joined #openstack-infra | 10:14 | |
| hashar | joa: unmanaged projects would be projects in Gerrit but not described in layout | 10:16 |
| hashar | or the other side around, i.e. described in layout but not in Gerrit | 10:16 |
| joa | okay | 10:17 |
| hashar | Zuul-merger will clone the repositories described in layout | 10:17 |
| hashar | then when a patch is proposed, the event reach Zuul server | 10:17 |
| hashar | which call a gearman function to realize a merge of that patch on the tip of the branch | 10:17 |
| hashar | that gearman function is grabbed by the Zuul-merger which craft the merge commit | 10:17 |
| hashar | and report back with the git URL to fetch the change from and the refs / commit | 10:18 |
| joa | and the actual jenkins job is configured on the first time it's triggered ? | 10:18 |
| hashar | then that is passed down to the job which should : git clone $ZUUL/PROJECT && git fetch $ZUUL_URL $ZUUL_REF && git checkout FETCH_HEAD | 10:18 |
| hashar | or something like that | 10:18 |
| *** emagana has quit IRC | 10:18 | |
| hashar | the job need to be configured manually in jenkins | 10:19 |
| hashar | Zuul does not magically create the jobs | 10:19 |
| hashar | :D | 10:19 |
| joa | Yeah but I mean. | 10:19 |
| joa | I created a Job (name/desc only) | 10:19 |
| joa | How do I tell zuul or jenkins to use that one for the triggers ? | 10:19 |
| joa | is it name-related ? | 10:19 |
| hashar | yeah that is the name of the job | 10:19 |
| joa | like I should use the same name as the one is the zuul project ? | 10:19 |
| hashar | need to be defined in zuul layout.yaml | 10:19 |
| hashar | something like: | 10:19 |
| hashar | - project: | 10:20 |
| hashar | name: dev/sandbox | 10:20 |
| hashar | check: | 10:20 |
| hashar | - noop-check-communication | 10:20 |
| hashar | then reload Zuul | 10:20 |
| hashar | it will now know it about dev/sandbox and if an event happen in Gerrit for that repo it is processed by the check pipeline | 10:20 |
| joa | okay so I should create a dev/sandbox job in jenkins for this kind of layout project ? | 10:21 |
| hashar | not sure I got that | 10:21 |
| joa | how can I put it... | 10:21 |
| joa | To link the jenkins job and the zuul layout | 10:22 |
| joa | in your example, there is a zuul layout project "dev/sandbox" | 10:22 |
| hashar | ah | 10:22 |
| hashar | that is the name of the Gerrit repository | 10:22 |
| joa | yup; but is the name relevant jenkins-side ? | 10:22 |
| hashar | not at all | 10:22 |
| hashar | the gerrit project name will be passed to the job as ZUUL_PROJECT | 10:23 |
| joa | Can I name it "my test job" and it should work; or should I name it dev/sandbox too ? | 10:23 |
| hashar | here an example for mediawiki/core http://git.wikimedia.org/blob/integration%2Fzuul-config.git/master/layout.yaml#L956 | 10:23 |
| hashar | line 963 is a jenkins job named php-composer-validate | 10:23 |
| hashar | that can be triggered by different project | 10:23 |
| joa | okaay. | 10:24 |
| joa | I think I get it. | 10:24 |
| hashar | the parameters are described at http://ci.openstack.org/zuul/launchers.html#zuul-parameters | 10:24 |
| joa | I'm now thinking: for beginners like me with zuul/jenkins; that might actually be the most important point: how components interact in openstack's testing infra | 10:24 |
| hashar | and there is a lame description to configure theJenkins git plugin at http://ci.openstack.org/zuul/launchers.html#jenkins-git-plugin-configuration | 10:25 |
| joa | I don't remember reading such details | 10:25 |
| hashar | I don't think there is any documentation explaining the big picture | 10:25 |
| hashar | maybe some blog posts | 10:25 |
| joa | I think it would be really worthwhile | 10:25 |
| *** jedimike has joined #openstack-infra | 10:26 | |
| joa | because as I didn't understand how it works between components, I was kind of lost | 10:26 |
| hashar | might want to ask again later this afternoon when US folks show up | 10:26 |
| hashar | or ask on the openstack-infra mailing list (you might want to subscribe to it) | 10:27 |
| jedimike | quick nodepool question: when do nodes get deleted? is it they've been used for a single zuul job? | 10:27 |
| joa | okay, soo. now to trigget some things. | 10:27 |
| hashar | that is where folks talk about zuul/jjb/nodepool/devstack etc | 10:27 |
| joa | hashar: I'm subscribed there, yeah didn't really ask yet | 10:27 |
| *** lttrl has joined #openstack-infra | 10:27 | |
| hashar | jedimike: I have no idea sorry :( | 10:27 |
| hashar | joa: http://ci.openstack.org/zuul/gating.html is a good read as well :D | 10:28 |
| jedimike | hashar, no problem, I can't find anything in the docs that specifies it, reading the code to figure it out now :) | 10:28 |
| joa | okay thanks | 10:28 |
| hashar | jedimike: https://github.com/openstack-infra/config/tree/master/modules/openstack_project/files/zuul has a bunch of related files. | 10:29 |
| jedimike | thanks | 10:30 |
| *** dims_ has joined #openstack-infra | 10:30 | |
| hashar | jedimike: and openstack_function.py has a method that sets OFFLINE_NODE_WHEN_COMPLETE https://github.com/openstack-infra/config/blob/master/modules/openstack_project/files/zuul/openstack_functions.py#L80 | 10:30 |
| hashar | jedimike: that might be used to unregister theJenkins slave on the instance | 10:30 |
| hashar | jedimike: then somehow NodePool probably detect the job has been completed on the node then eventually trigger the deletion | 10:30 |
| hashar | jedimike: if you find anything, http://ci.openstack.org/nodepool/ might need some additions :-] | 10:31 |
| jedimike | yeah I think it might :) | 10:31 |
| joa | Well, nothing seems to be triggered. I might be missing some things... | 10:33 |
| *** Alexei_987 has quit IRC | 10:34 | |
| *** dims_ has quit IRC | 10:34 | |
| *** Evgeny has quit IRC | 10:37 | |
| *** Longgeek has quit IRC | 10:39 | |
| *** Guest58876 has quit IRC | 10:41 | |
| *** vhoward has joined #openstack-infra | 10:45 | |
| *** rlandy has joined #openstack-infra | 10:49 | |
| *** ildikov has joined #openstack-infra | 10:53 | |
| *** pblaho-lunch is now known as pblaho | 10:55 | |
| *** Azher has quit IRC | 11:00 | |
| openstackgerrit | A change was merged to openstack-infra/git-review: Disable ssh/scp password authentication during tests https://review.openstack.org/97025 | 11:01 |
| openstackgerrit | A change was merged to openstack-infra/config: new project called refstack-client https://review.openstack.org/106181 | 11:01 |
| *** salv-orlando has quit IRC | 11:01 | |
| x1b2j | hi everyone, i have an issue while launching the vm, while using docker as a hypervisor in openstack. i am getting the following error : | 11:02 |
| x1b2j | Error: Failed to launch instance "centos": Please try again later [Error: No valid host was found. ]. | 11:03 |
| x1b2j | the nova-scheduler logs can be found at : https://gist.github.com/anonymous/4e813ea82859bc418397 | 11:03 |
| *** jcoufal has quit IRC | 11:03 | |
| x1b2j | please, help. thanks. | 11:03 |
| openstackgerrit | A change was merged to openstack-infra/config: Add subunit2sql to openstack-infra https://review.openstack.org/102392 | 11:04 |
| *** juzuluag has joined #openstack-infra | 11:04 | |
| *** jcoufal has joined #openstack-infra | 11:04 | |
| *** alexpilotti has joined #openstack-infra | 11:07 | |
| Ajaeger | x1b2j: Please ask on #openstack. This channel is for running the OpenStack infrastructure itself | 11:08 |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Support the Store SCM plugin https://review.openstack.org/85729 | 11:09 |
| openstackgerrit | A change was merged to openstack-infra/config: Create git repo and jenkins jobs for oslo.utils https://review.openstack.org/101230 | 11:10 |
| *** maxbit has quit IRC | 11:11 | |
| *** xianghui has quit IRC | 11:11 | |
| *** jamielennox is now known as jamielennox|away | 11:12 | |
| openstackgerrit | A change was merged to openstack-infra/config: Sprinkle in more USE_IRONIC to TripleO jobs https://review.openstack.org/105927 | 11:13 |
| x1b2j | Ajaeger: sorry for the trouble, and thanks for pointing out the mistake. | 11:13 |
| *** hashar has quit IRC | 11:13 | |
| *** emagana has joined #openstack-infra | 11:15 | |
| *** jyuso has quit IRC | 11:15 | |
| *** openstackgerrit has quit IRC | 11:16 | |
| *** yaguang has quit IRC | 11:18 | |
| *** openstackgerrit has joined #openstack-infra | 11:18 | |
| openstackgerrit | A change was merged to openstack-infra/config: Update partially translated glossary https://review.openstack.org/105372 | 11:19 |
| *** emagana has quit IRC | 11:19 | |
| *** Evgeny has joined #openstack-infra | 11:21 | |
| *** trinaths has quit IRC | 11:21 | |
| openstackgerrit | A change was merged to openstack-infra/config: Fix neutron func job sudo config. https://review.openstack.org/105926 | 11:22 |
| *** skolekonov has quit IRC | 11:24 | |
| *** julim has joined #openstack-infra | 11:24 | |
| *** dims_ has joined #openstack-infra | 11:25 | |
| *** julim has quit IRC | 11:27 | |
| openstackgerrit | Sergey Skripnick proposed a change to openstack-infra/devstack-gate: Add option to edit ceilometer notification topics https://review.openstack.org/104123 | 11:27 |
| *** luqas has quit IRC | 11:35 | |
| *** markwash has quit IRC | 11:36 | |
| openstackgerrit | A change was merged to openstack-infra/gerritbot: replace dict.iteritems() with six.iteritems(dict) https://review.openstack.org/95727 | 11:38 |
| *** jcoufal has quit IRC | 11:39 | |
| *** markwash has joined #openstack-infra | 11:40 | |
| *** viktors has joined #openstack-infra | 11:40 | |
| *** maxbit has joined #openstack-infra | 11:42 | |
| *** julim has joined #openstack-infra | 11:44 | |
| *** yfried__ has joined #openstack-infra | 11:45 | |
| *** e0ne has joined #openstack-infra | 11:48 | |
| *** alexpilotti has quit IRC | 11:48 | |
| *** julim has quit IRC | 11:49 | |
| *** hashar has joined #openstack-infra | 11:54 | |
| *** hashar_ has joined #openstack-infra | 11:55 | |
| *** e0ne has quit IRC | 11:57 | |
| *** hashar has quit IRC | 11:59 | |
| *** k4n0 has quit IRC | 12:00 | |
| *** eharney has quit IRC | 12:04 | |
| *** hashar_ is now known as hashar | 12:06 | |
| *** jcoufal-mobile has quit IRC | 12:07 | |
| *** jcoufal-mobile_ has joined #openstack-infra | 12:07 | |
| *** jgallard has joined #openstack-infra | 12:07 | |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Adding Search endpoints and sqlalchemy impl https://review.openstack.org/101476 | 12:08 |
| *** Evgeny has quit IRC | 12:10 | |
| *** bknudson has joined #openstack-infra | 12:15 | |
| *** aysyd has joined #openstack-infra | 12:16 | |
| *** mbacchi has joined #openstack-infra | 12:16 | |
| *** emagana has joined #openstack-infra | 12:16 | |
| *** eharney has joined #openstack-infra | 12:17 | |
| *** pcm_ has joined #openstack-infra | 12:17 | |
| *** rfolco has joined #openstack-infra | 12:18 | |
| *** bknudson has quit IRC | 12:20 | |
| *** jcoufal-mobile_ has quit IRC | 12:20 | |
| *** emagana has quit IRC | 12:20 | |
| *** jcoufal-mobile_ has joined #openstack-infra | 12:21 | |
| *** krtaylor has quit IRC | 12:22 | |
| *** alaski has joined #openstack-infra | 12:22 | |
| joa | hashar: I think I got what I missed. | 12:24 |
| joa | did not configure git in the job I manually created. That being said; I feel like my ssh key doesn't work... | 12:24 |
| hashar | joa: ah | 12:24 |
| hashar | joa: you might need to manually accept some ssh fingerprint | 12:25 |
| joa | mhh I cant clone actually. We agree that the proper gerrit URI is ssh://review.openstack.com:29418 ? | 12:26 |
| hashar | no clue :D | 12:26 |
| *** julim has joined #openstack-infra | 12:26 | |
| hashar | try to su as the user running zuul | 12:26 |
| hashar | then ssh -p 29418 JohnDoe@review.openstack.org | 12:27 |
| hashar | replacing JohnDoe with whatever | 12:27 |
| *** Evgeny has joined #openstack-infra | 12:27 | |
| *** Evgeny_ has joined #openstack-infra | 12:29 | |
| *** Evgeny has quit IRC | 12:29 | |
| *** eharney has quit IRC | 12:29 | |
| joa | whelp. key issue it seems. strange; I was sure it was working | 12:30 |
| *** dprince has joined #openstack-infra | 12:30 | |
| *** pdmars has joined #openstack-infra | 12:30 | |
| *** pdmars has quit IRC | 12:31 | |
| *** mfink has quit IRC | 12:31 | |
| joa | ah. made it work. | 12:31 |
| *** pdmars has joined #openstack-infra | 12:32 | |
| *** radez_g0n3 is now known as radez | 12:32 | |
| openstackgerrit | Flavio Percoco proposed a change to openstack-infra/config: Create the glance.stores repo https://review.openstack.org/106361 | 12:32 |
| *** chuckC has joined #openstack-infra | 12:32 | |
| sdague | so for when folks wake up - the rax mirror issue is now our top reset issue - Bug 1286818 - Ubuntu mirror periodically inconsistent causing gate build failures | 12:34 |
| sdague | 12:34 | |
| uvirtbot | Launchpad bug 1286818 in openstack-ci "Ubuntu mirror periodically inconsistent causing gate build failures" [Low,Triaged] https://launchpad.net/bugs/1286818 | 12:34 |
| sdague | Bug 1286818 - Ubuntu mirror periodically inconsistent causing gate build failures | 12:34 |
| sdague | 211 fails in 24hrs / 282 fails in 14 days | 12:34 |
| *** bknudson has joined #openstack-infra | 12:35 | |
| Ajaeger | That's quite an increase ;( | 12:35 |
| sdague | yep | 12:35 |
| *** amitpp has quit IRC | 12:36 | |
| *** annegent_ has joined #openstack-infra | 12:38 | |
| *** obondarev has joined #openstack-infra | 12:38 | |
| fungi | fun stuff | 12:38 |
| *** mfink_ has joined #openstack-infra | 12:39 | |
| openstackgerrit | A change was merged to openstack-infra/config: propose_translation_update: Handle .tx/config in git https://review.openstack.org/82384 | 12:39 |
| joa | hashar: one last question about the git repo URL... I must (at least) configure one job per git repository to be checked, right ? | 12:39 |
| openstackgerrit | Flavio Percoco proposed a change to openstack-infra/config: Create the glance.stores repo https://review.openstack.org/106361 | 12:41 |
| *** mestery has joined #openstack-infra | 12:42 | |
| openstackgerrit | A change was merged to openstack-infra/config: Quiet test.sh output https://review.openstack.org/104751 | 12:42 |
| *** luqas has joined #openstack-infra | 12:42 | |
| *** weshay has joined #openstack-infra | 12:42 | |
| sdague | fungi: so https://github.com/puppetlabs/puppetlabs-vcsrepo seems to have picked up steam | 12:45 |
| sdague | how different is our vcsrepo from the upstream? | 12:45 |
| *** Evgeny_ has quit IRC | 12:45 | |
| openstackgerrit | A change was merged to openstack-infra/config: yum grouplist response on F20 is lower case https://review.openstack.org/105024 | 12:45 |
| sdague | could we cut over? because clearly based on the os-loganalyze fail yesterday, the exec signal doesn't seem to work reliably on ours | 12:45 |
| *** dims_ has quit IRC | 12:46 | |
| *** salv-orlando has joined #openstack-infra | 12:47 | |
| *** dims_ has joined #openstack-infra | 12:47 | |
| *** adalbas has joined #openstack-infra | 12:47 | |
| fungi | jedimike: nodepool deletes nodes as quickly as it can after the jobs which ran on them complete, so that it can free up available quota for new workers. the faster it does that, the more jobs we can run | 12:50 |
| *** oanufriev has joined #openstack-infra | 12:50 | |
| jedimike | fungi, that's what I thought, the problem we're having is when we're under load, it can take up to 10 minutes to delete a node | 12:50 |
| sdague | fungi: I wonder if we've got a load balance issue with not enough trusty in the mix | 12:50 |
| sdague | because we seem to have idle capacity, but still waiting on nodes for 20 - 30 mins | 12:51 |
| sdague | though the massive mirror fails mean a ton of churn | 12:51 |
| fungi | sdague: i suspect we need to re-tune the min-ready counts on some of our labels downward. i'll look at the breakdown in a bit. also possible we have nodes stuck in ready/building which the jenkins masters lost track of | 12:52 |
| fungi | as for vcsrepo, we had a fundamental design difference, in that we needed to be able to specify particular git refs, and they wanted to be able to be vcs-agnostic which meant lowest-common-denominator featureset, which left our use case out in the cold. could have changes since though | 12:53 |
| fungi | s/changes/changed/ | 12:53 |
| sdague | fungi: ok, good point | 12:53 |
| sdague | well it looks like they started merging a ton of stuff in the last 2 months | 12:53 |
| sdague | and it's now "officially supported" for git | 12:53 |
| sdague | with a 1.0.1 release | 12:53 |
| sdague | so maybe it would be a good time to reengage | 12:53 |
| fungi | jedimike: we've seen providers be slow to react to nova delete calls, or outright ignore them. nodepool periodically retries to delete and eventually manages to do so except in some rare cases where nova gets wedged at the provider | 12:54 |
| sdague | because all those edge cases in it not working right kind of suck | 12:54 |
| fungi | jedimike: you might also check your nodepool log for error replies coming back from the nova api calls which could mention things like your api calls getting rate-limited. there is a delay parameter you can tweak per-provider in the nodepool config to keep from running afoul of api rate limits (which seem to vary between providers) | 12:55 |
| flaper87 | sdague: when did you start seeing glance's deadlocks in the gate? Did something change in the gate? multiworker ? | 12:56 |
| fungi | sdague: which specific edge cases do we have for it not working? i've probably either forgotten or missed discussion | 12:56 |
| sdague | flaper87: multi worker | 12:56 |
| sdague | it corolates very highly to multiwork enabling | 12:57 |
| jedimike | fungi, thanks, we had some quota issues last week, but they've been sorted now. I think I need to do some log parsing to see exactly where the delays are with the deletes. Cheers! | 12:57 |
| flaper87 | I'm digging into it but at first glance it's not clear to me what is causing that error | 12:57 |
| openstackgerrit | A change was merged to openstack-infra/config: Add new stackforge project, rack https://review.openstack.org/105098 | 12:57 |
| *** anonitus has quit IRC | 12:57 | |
| flaper87 | sdague: ok, I'll dig into it deeper | 12:57 |
| flaper87 | thanks | 12:57 |
| sdague | flaper87: do you have a functional test that tries to do metadata updates simultaneously? | 12:57 |
| sdague | because that's when it seems to be happening | 12:58 |
| flaper87 | sdague: we don | 12:58 |
| flaper87 | ops | 12:58 |
| flaper87 | sdague: we don't but I'll start adding one | 12:58 |
| flaper87 | I think I know why it's happening | 12:58 |
| sdague | flaper87: yeh, I think if you build that, the reproduce will be pretty easy | 12:58 |
| sdague | fungi: well yesterday when we landed a bunch of os-loganalyze patches this - https://github.com/openstack-infra/config/blob/master/modules/openstack_project/manifests/static.pp#L116 clearly didn't happen | 13:00 |
| sdague | until clarkb deleted the whole tree | 13:00 |
| *** annegent_ has quit IRC | 13:00 | |
| fungi | sdague: did he mention what error he was hitting? the biggest problem i've witnessed is on older clones where we still had origin set to github and then github flakes out | 13:01 |
| sdague | fungi: I don't know | 13:01 |
| fungi | vcsrepo doesn't (by default) change your remotes | 13:01 |
| *** _nadya_ has joined #openstack-infra | 13:01 | |
| fungi | so if you delete the whole clone, it re-clones from the configured origin | 13:01 |
| sdague | it looked like the local repo was at the right hash | 13:01 |
| sdague | but the egg was not | 13:01 |
| *** dustins has joined #openstack-infra | 13:02 | |
| sdague | which makes me think there is an issue with the update signalling | 13:02 |
| sdague | and... I feel like I've seen that before | 13:02 |
| fungi | oh. in those cases i'm not sure it's vcsrepo. i've suspected something going on somehwere else in puppet/pbr/pip but haven't pinned it down | 13:02 |
| *** _nadya_ has quit IRC | 13:02 | |
| sdague | ok | 13:02 |
| fungi | unfortunately puppet's logging of stdout/stderr from exec calls is abhorrent | 13:03 |
| sdague | so I don't know why it didn't happen, but it would be good to fix, because right now we think we have CD and... we seem not to | 13:03 |
| Ajaeger | fungi: Yesterday https://review.openstack.org/98238 was merged, it added new translation jobs, e.g. one for barbican. | 13:03 |
| Ajaeger | But none of this was run as part of the daily translation import. The jobs exist e.g. https://jenkins.openstack.org/view/All/job/barbican-propose-translation-update/ | 13:03 |
| Ajaeger | They're also not run as part of the post jobs. | 13:03 |
| sdague | so every land is going to require babysitting | 13:03 |
| Ajaeger | any ideas? | 13:03 |
| fungi | my guess is that vcsrepo does actually emit the update event, but then puppet's refresh/subscribe exec hits some error and dies. then doesn't get retried until the next time the branch updates | 13:04 |
| fungi | sdague: ^ | 13:04 |
| fungi | Ajaeger: looking | 13:04 |
| Ajaeger | fungi, thanks | 13:04 |
| sdague | fungi: ah, gotcha | 13:04 |
| *** Guest58876 has joined #openstack-infra | 13:05 | |
| sdague | fungi: maybe it would be nice for vcsrepo to have a post call directly in it | 13:05 |
| sdague | or.... we could create a post-receive hook in the repo? | 13:05 |
| fungi | sdague: yeah, maybe the new one can do that and skip puppet's exec orchestration entirely. as we've already observed, puppet is not great at orchestration, and is designed more for config management | 13:06 |
| fungi | puppet does well when you have a state you want things in and can specify that state. however if you want to have something done as a result of something else, not so well adapted i'm afraid | 13:07 |
| openstackgerrit | A change was merged to openstack-infra/storyboard: Update _route method usage https://review.openstack.org/105766 | 13:07 |
| sdague | yeh | 13:07 |
| fungi | Ajaeger: so, per the current zuul configuration, that job should have been triggered at 06:00 utc | 13:08 |
| Ajaeger | but it wasn't ;( | 13:10 |
| Ajaeger | strange | 13:10 |
| *** mfer has joined #openstack-infra | 13:11 | |
| *** xianghui has joined #openstack-infra | 13:12 | |
| *** Evgeny has joined #openstack-infra | 13:12 | |
| fungi | https://review.openstack.org/98238 should have added it to the zuul configuration shortly after 20:54 utc yesterday when it merged | 13:14 |
| fungi | zuul's statuc page indicates it's definitely reloaded its config since then, but i'll double-check the timeline from its logs | 13:14 |
| fungi | s/statuc/status/ | 13:14 |
| fungi | showed up in a config reload at 21:10:07 according to zuul.log | 13:16 |
| *** jp_at_hp has quit IRC | 13:16 | |
| *** emagana has joined #openstack-infra | 13:16 | |
| openstackgerrit | A change was merged to openstack-infra/config: Remove puppet-dashboard.o.o from cacti https://review.openstack.org/101292 | 13:16 |
| *** bknudson has quit IRC | 13:17 | |
| *** prad has joined #openstack-infra | 13:17 | |
| *** mriedem has joined #openstack-infra | 13:18 | |
| openstackgerrit | A change was merged to openstack-infra/config: Ignore .egg directories https://review.openstack.org/96250 | 13:18 |
| *** mwagner_lap has joined #openstack-infra | 13:18 | |
| *** mwagner_lap is now known as mwagner_rdu | 13:19 | |
| fungi | Ajaeger: seems this happened when it tried to run... http://paste.openstack.org/show/86098/ | 13:20 |
| fungi | checking now to see when jjb finished adding the job to jenkins.o.o | 13:20 |
| *** yaguang has joined #openstack-infra | 13:21 | |
| *** emagana has quit IRC | 13:21 | |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Adding api events notifier and listener https://review.openstack.org/102842 | 13:21 |
| *** jp_at_hp has joined #openstack-infra | 13:21 | |
| fungi | er, sorry, i'm having bounce problems with my paste button... http://paste.openstack.org/show/86099/ | 13:21 |
| *** changbl has quit IRC | 13:22 | |
| *** annegent_ has joined #openstack-infra | 13:22 | |
| fungi | drwxr-xr-x 4 jenkins nogroup 4096 Jul 10 21:25 barbican-propose-translation-update | 13:22 |
| fungi | so for whatever reason, it didn't manage to register it with gearman when it added the job... | 13:22 |
| *** che-arne has joined #openstack-infra | 13:23 | |
| *** emagana has joined #openstack-infra | 13:23 | |
| *** homeless has joined #openstack-infra | 13:23 | |
| fungi | ohhhh | 13:23 |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Adding subsription model and DB API https://review.openstack.org/106037 | 13:24 |
| Ajaeger | oops ;( | 13:24 |
| *** emagana has quit IRC | 13:24 | |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Adding api events notifier and listener https://review.openstack.org/102842 | 13:24 |
| *** emagana has joined #openstack-infra | 13:25 | |
| openstackgerrit | A change was merged to openstack-infra/storyboard-webclient: Fix for last updated property of a story https://review.openstack.org/105427 | 13:25 |
| fungi | it looks like maybe jjb created the job configuration at 21:25 yesterday, but didn't manage to get it into the jenkins service until around 06:24 this morning... http://paste.openstack.org/show/86100/ | 13:25 |
| *** baohua has quit IRC | 13:26 | |
| Ajaeger | so, it should run tomorrow - great... | 13:26 |
| joa | fungi o/ I'm still running with infra questions :D | 13:27 |
| *** dkliban_afk is now known as dkliban | 13:28 | |
| *** yaguang has quit IRC | 13:28 | |
| fungi | Ajaeger: ahh, found a traceback in the jenkins.log on the master | 13:28 |
| *** annegent_ has quit IRC | 13:28 | |
| openstackgerrit | Christian Berendt proposed a change to stackforge/python-jenkins: Enabled hacking check H404 https://review.openstack.org/106374 | 13:28 |
| *** annegentle is now known as notsogentle | 13:29 | |
| *** jgrimm has quit IRC | 13:29 | |
| *** rickerc has joined #openstack-infra | 13:29 | |
| *** emagana has quit IRC | 13:30 | |
| *** jaypipes has joined #openstack-infra | 13:31 | |
| fungi | zomg it's the traceback that never ends | 13:32 |
| openstackgerrit | Flavio Percoco proposed a change to openstack-infra/config: Create the glance.stores repo https://review.openstack.org/106361 | 13:32 |
| Ajaeger | fungi: https://jenkins.openstack.org/job/barbican-upstream-translation-update/1/ - the job is running now! | 13:32 |
| Ajaeger | So, that part looks fine! | 13:32 |
| *** matrohon has joined #openstack-infra | 13:32 | |
| *** jcoufal-mobile_ has quit IRC | 13:33 | |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Migrate to oslo.db https://review.openstack.org/105430 | 13:33 |
| *** jcoufal-mobile_ has joined #openstack-infra | 13:33 | |
| *** krtaylor has joined #openstack-infra | 13:34 | |
| *** homeless has quit IRC | 13:34 | |
| *** homeless has joined #openstack-infra | 13:35 | |
| fungi | Ajaeger: so if you want to see a fun java traceback or two, here's what happened on the jenkins master when it tried to apply that job after the initial jjb run... http://paste.openstack.org/show/86102/ | 13:39 |
| Ajaeger | Not sure I want ;) | 13:39 |
| fungi | it looks like a subsequent jjb run shortly after 06:00 worked, but as a result the job wasn't registered yet when the other periodics kicked off at 06:00 | 13:40 |
| Ajaeger | fungi, was there an error in my patch? | 13:40 |
| fungi | Ajaeger: no, i think there's an error in jenkins | 13:40 |
| Ajaeger | The barbican-upstream-translation-update job that was part of the patch set is now registered. | 13:41 |
| Ajaeger | See above | 13:41 |
| fungi | yep | 13:41 |
| Ajaeger | Do you think it's healed now? | 13:41 |
| fungi | Ajaeger: looks like it... http://paste.openstack.org/show/86104/ | 13:43 |
| fungi | that shows that the job is now registered in gearman and associated with the proposal worker | 13:43 |
| *** HenryG has joined #openstack-infra | 13:43 | |
| Ajaeger | fungi: Good! I'll monitor the next days again and speak up if it does not work... | 13:43 |
| Ajaeger | fungi: thanks! | 13:43 |
| fungi | yw! | 13:43 |
| fungi | joa: so what were your questions? | 13:44 |
| *** pcrews has joined #openstack-infra | 13:44 | |
| joa | Well, I *think* I fixed the zuul part; but I'm still wondering what can I use to _check_ whether a trigger is properly associated to a configured check; and whether it's properly associated to a jenkins-configured job | 13:45 |
| joa | because zuul seems alright; jenkins too; but the link between the twoo.. I'm not so sure | 13:45 |
| Ajaeger | fungi: I noticed that glance was only running one of the two translation jobs so added this one: https://review.openstack.org/106282 | 13:45 |
| Ajaeger | Now time for a break, talk to you later again | 13:45 |
| Ajaeger | Designate translation post-job has been run successfully as well ;) | 13:47 |
| *** dstanek is now known as dstanek_zzz | 13:47 | |
| *** trinaths has joined #openstack-infra | 13:49 | |
| fungi | joa: so... the nc trick hashar showed you to connect to the gearman server and enumerate the registered jobs... do you not see any of your jenkins jobs showing up in that output? | 13:49 |
| joa | I do see the jenkins job configured in there | 13:49 |
| *** oanufriev has quit IRC | 13:49 | |
| joa | but when I comment on a sandbox patchset | 13:49 |
| joa | (with a recheck) | 13:50 |
| *** markmcclain has joined #openstack-infra | 13:50 | |
| fungi | okay, so it sounds like the jenkins master is connecting to zuul's gearman server correctly | 13:50 |
| joa | no job is run | 13:50 |
| joa | yeah; the "testing button" in the configure UI said the connection was okay | 13:50 |
| fungi | in your zuul debug log, do you see it mention noticing an event for the change coming from your gerrit event stream? | 13:50 |
| *** obondarev has quit IRC | 13:50 | |
| fungi | if so, then the event stream is hooked up correctly... you should be able to see details of the event in your debug log including project name. you'll want to make sure that project exists exactly as listed in your zuul layout.yaml | 13:51 |
| joa | Well, I see events in the debug log, for sure | 13:52 |
| fungi | project names in zuul's layout are expected to be an exact match for the project name included in a gerrit event | 13:53 |
| joa | lemme clean up logs and restart the things; for a clean view | 13:53 |
| *** [1]trinaths has joined #openstack-infra | 13:53 | |
| joa | ok | 13:53 |
| fungi | joa: you should be able to search the debug log for the change number | 13:53 |
| joa | so openstack-dev/sandbox ; for the sandbox repo ? | 13:53 |
| fungi | yeop | 13:53 |
| fungi | er, yep | 13:53 |
| openstackgerrit | A change was merged to openstack-infra/release-tools: Fix issues in milestone.sh swift support https://review.openstack.org/105226 | 13:54 |
| fungi | joa: if you point me to the sandbox change you commented on, i can tell you what the event for your comment looks like in our zuul logs | 13:54 |
| *** trinaths has quit IRC | 13:55 | |
| *** [1]trinaths is now known as trinaths | 13:55 | |
| joa | okay (Had some zuul-server zombies running, prevented me from restarting properly, cleaning it up) | 13:56 |
| joa | https://review.openstack.org/#/c/103408/ -> Saw events pop in the log | 13:58 |
| joa | I guess the next events were triggered by the other CI systems commenting their results | 13:59 |
| fungi | yep, you'll get events for everything happening in gerrit | 13:59 |
| joa | so I see the events properly, but no idea why it doesn't trigger anything within my jenkins | 14:00 |
| fungi | zuul has to filter through those to find the events it cares about | 14:00 |
| *** jistr has quit IRC | 14:00 | |
| fungi | okay, so the next question... can you stick your current layout.yaml on http://paste.openstack.org/ and give me the url? | 14:00 |
| joa | yup | 14:00 |
| anteaya | SergeyLukjanov: thank you for +A 105926 | 14:01 |
| fungi | that way we can see whether your triggers are associated with a pipeline which is included for the project of interest | 14:01 |
| joa | http://paste.openstack.org/show/86110/ | 14:01 |
| *** jistr has joined #openstack-infra | 14:02 | |
| *** eharney has joined #openstack-infra | 14:03 | |
| fungi | joa: okay, so i think i see the issue. your comment_filter isn't going to match on any gerrit 2.8 comments. it looks like it was written for back when openstack was still running gerrit 2.4 | 14:03 |
| joa | ohhh | 14:03 |
| joa | darn :D | 14:03 |
| fungi | we have a newer comment filter in our layout.yaml... link coming | 14:04 |
| joa | oh okay | 14:04 |
| joa | I'm sad now :D | 14:04 |
| fungi | joa: don't be sad... rejoice in http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml#n18 | 14:04 |
| joa | that's because I'm thinking of all that time spent trying to understand an "obvious" issue for those who know :D | 14:05 |
| *** wenlock has joined #openstack-infra | 14:05 | |
| fungi | newer gerrit versions include a header in the comment message which includes the patchset number and votes (if any) accompanying the comment | 14:05 |
| joa | okay | 14:06 |
| joa | soo... | 14:06 |
| joa | I should only take recheck, reverify, and modify the one with the vendor-specific recheck ? | 14:06 |
| *** carl_baldwin has joined #openstack-infra | 14:06 | |
| fungi | you can actually see the full text of the comment in the gerrit event, but it may not have been intuitive to compare your regex against it (or realize that it needed to match multi-line outut) | 14:06 |
| *** trinaths has quit IRC | 14:07 | |
| *** xianghui has quit IRC | 14:07 | |
| openstackgerrit | A change was merged to openstack-infra/config: Be verbose in gate hoook for requirements job https://review.openstack.org/102576 | 14:08 |
| fungi | and yeah, you'll notice that basically what we changed in those regular expressions was to prepend ^(Patch Set [0-9]+:)?( [\w\\+-]*)*(\n\n)? | 14:08 |
| fungi | to absorb the header and blank line separating it from the comment text | 14:08 |
| joa | yeah, noticed that | 14:09 |
| fungi | so in theory that's all your old regexes need to be modified to account for | 14:09 |
| joa | the older one identified a different line starter so obviously, couldnt work | 14:09 |
| fungi | right | 14:09 |
| fungi | basically, we ran into the same problem when preparing to upgrade from gerrit 2.4 to 2.8 a few months ago | 14:10 |
| joa | Should a 3rd-party manage both rechecks* and reverify ? | 14:10 |
| fungi | and jaypipes's blog examples probably predate that | 14:10 |
| *** emagana has joined #openstack-infra | 14:10 | |
| joa | Yeah I guess | 14:10 |
| joa | well, he obviously says wip | 14:10 |
| joa | but I didnt think of dating issues; as his article is pretty-much the only one actually talking about all that | 14:10 |
| fungi | joa: i suspect that third-party ci, for the most part, doesn't need to care about the gate pipeline at all, nor about reverify comments (that's all associated with changes which have already been approved) | 14:11 |
| joa | I need to type down some of the issues I've encountered to prepare a small caveat/howto | 14:11 |
| joa | Okay so I'll remove it. | 14:11 |
| fungi | the check pipeline is where changes are getting triggered while they're still in review | 14:11 |
| joa | Should I remove the gate pipeline altogether from my layout then ? | 14:11 |
| fungi | i would | 14:11 |
| joa | okay I'll do it | 14:12 |
| joa | the simpler the better :D | 14:12 |
| *** dstanek_zzz is now known as dstanek | 14:12 | |
| fungi | but given that i don't run a third-party ci system, i can't say for certain there's no value in having it | 14:12 |
| joa | well, I'll add it if need be | 14:12 |
| fungi | it just seems to me to be unlikely to be of much benefit | 14:12 |
| joa | it will be simpler then | 14:12 |
| joa | Ookay.. time to comment things then | 14:13 |
| fungi | joa: the other third-party ci operators would probably also love to hear a report from you in their next weekly irc meeting too, since they may be struggling with similar configuration issues | 14:13 |
| joa | when is infra's meeting ? | 14:14 |
| joa | kind of on holidays from the 16th :p | 14:14 |
| fungi | the openstack project infrastructure team meets in irc on tuesdays at 19:00 utc, but there's a third-party ci ad hoc group which i believe conducts weekly meetings too | 14:14 |
| *** ildikov has quit IRC | 14:14 | |
| fungi | and i was referring to the latter | 14:14 |
| joa | Ohhh.. something appeared on jenkins \o/ | 14:14 |
| joa | oh okay | 14:15 |
| joa | so I'd need to find out their timeslot | 14:15 |
| fungi | joa: https://wiki.openstack.org/wiki/Meetings | 14:15 |
| *** nelsnels_ has quit IRC | 14:15 | |
| joa | Thanks. I should bookmark that. | 14:15 |
| *** bknudson has joined #openstack-infra | 14:15 | |
| fungi | appears to be mondays at 1800 | 14:16 |
| *** rkukura has joined #openstack-infra | 14:18 | |
| Kiall | fungi - We've got changes Anne wanted for publishing Designate docs ready to go - Are you happy to approve https://review.openstack.org/#/c/103349/ ? (Rendered docs are @ http://docs-draft.openstack.org/25/106025/3/check/gate-designate-docs/d6a5c00/doc/build/html/ ) | 14:19 |
| *** YorikSar has quit IRC | 14:19 | |
| joa | Well, the build fails | 14:19 |
| joa | but it should prove to be easier to fix :D | 14:19 |
| joa | haem "build" is a big word though :D | 14:20 |
| *** bknudson has quit IRC | 14:22 | |
| *** nelsnelson has joined #openstack-infra | 14:22 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/requirements: Add cm_api to global requirements https://review.openstack.org/106011 | 14:24 |
| *** adrian_otto has joined #openstack-infra | 14:25 | |
| fungi | sdague: watching zuul status progress and checking the nodepool label balance, it looks like nodepool's assignment algorithm is currently favoring devstack-trusty over bare-trusty and so the former is getting assigned slightly ahead of the latter (by as much as a few minutes). that could just be due to the lag in building replacement nodes causing some minor balance issues in the demand calculations. | 14:25 |
| fungi | i don't currently see that it's skewed enough to warrant any modifications though | 14:25 |
| fungi | devstack-precise seems to lag behind a bit as well (so stable branch changes are waiting a bit longer in check than master branch changes) | 14:26 |
| *** mwagner_rdu has quit IRC | 14:26 | |
| *** oanufriev has joined #openstack-infra | 14:27 | |
| *** morganfainberg_Z is now known as morganfainberg | 14:27 | |
| fungi | but really, the devstack nodes getting assigned sooner is probably helpful anyway since the jobs we run on those tend to take longer on average than those we run on bare nodes | 14:27 |
| *** annegentle has joined #openstack-infra | 14:28 | |
| fungi | and i found no obvious signs nodepool was unhealthy... no appreciable number of nodes stuck in a ready state, none stuck in building or used | 14:28 |
| *** annegentle is now known as Guest65545 | 14:28 | |
| sdague | fungi: yeh, it didn't seem major | 14:28 |
| *** banix has joined #openstack-infra | 14:28 | |
| sdague | it was a slight imbalance | 14:28 |
| *** gargola has joined #openstack-infra | 14:29 | |
| joa | Okay so the issue of the build seems to lie in bad git setup :o | 14:30 |
| fungi | joa: so many moving parts. it's a wonder we keep any of it working ;) | 14:31 |
| joa | hehe | 14:31 |
| fungi | sdague: the gate definitely looks much healthier after that postgres tuning patch | 14:31 |
| joa | Well that's what I discussed with hashar; I felt like the few docs I could have read | 14:31 |
| joa | didnt really cover much of the interactions between the components of the CI infra | 14:31 |
| joa | so it was really hard to guess where the issue was coming from | 14:32 |
| hashar | Jay tutorials probably deserve an update | 14:32 |
| hashar | would be rather tnice to have a third party section at http://ci.openstack.org | 14:32 |
| fungi | joa: the slide presentations try to address some of that at a higher conceptual level, but like most slide presentations sort of skip over some of the detail so we can fit them into typical conference talk slots | 14:32 |
| hashar | ah there is http://ci.openstack.org/third_party.html | 14:32 |
| joa | Sure, though not being a pupet expert (more like noobish-dont-wanna-touch-that), I miss some things. | 14:32 |
| sdague | fungi: yeh... well now we're bouncing on the rax mirror | 14:32 |
| sdague | not nearly so bad | 14:32 |
| sdague | but still pretty bad | 14:33 |
| joa | but I might do a small complementary write-up to accompany jaypipe's article | 14:33 |
| fungi | sdague: agreed, i'm digging up the contact info i have for the rax ubuntu mirror sysadmin to see if he can shed any light on it (if he's still the same one running it) | 14:33 |
| fungi | joa: it would be really, really awesome if you, jaypipes and others collaborated on updating http://git.openstack.org/cgit/openstack-infra/config/tree/doc/source/third_party.rst | 14:34 |
| fungi | joa: getting that changed to be a comprehensive writeup of setting up the tools the openstack infrastructure team actively maintains would be much more useful in that document than the current pointer to the gerrit trigger plugin for jenkins (which we really don't use at all and can't provide any decent help on) | 14:36 |
| *** bknudson has joined #openstack-infra | 14:36 | |
| openstackgerrit | A change was merged to openstack-infra/config: Added devstack job for manila https://review.openstack.org/99933 | 14:36 |
| joa | fungi: yup agreed. Thanks for pointing the right document :) | 14:36 |
| joa | this rst also goes through gerrit, right ? | 14:37 |
| *** jgrimm has joined #openstack-infra | 14:37 | |
| fungi | joa: as great as it is that people blog about their experiences and configurations, blogs slide into a stale state and pointing newcomers to a disjoint pile of blog post urls isn't nearly so helpful | 14:37 |
| fungi | and yep, that repository is managed through gerrit just like the rest of our projects | 14:38 |
| joa | yup, that's the issue with blogs. You need a recent one :p | 14:38 |
| fungi | and the documentation in it is continuously deployed to the http://ci.openstack.org/ website | 14:38 |
| openstackgerrit | Flavio Percoco proposed a change to openstack-infra/config: Create the glance.store repo https://review.openstack.org/106361 | 14:38 |
| joa | or you need a real stable project, not a developping one :p | 14:38 |
| joa | Should I do some blueprint/bug report before submitting a patch on a rst ? | 14:38 |
| fungi | joa: nah, just edit the file, send it into review.openstack.org and let reviewers pick it apart or approve it as needed | 14:39 |
| joa | I'm still not exactly at ease with the gerrit system (cnotably the conditions before submitting and the branch naming to submit too) | 14:39 |
| *** freyes has quit IRC | 14:39 | |
| joa | okay | 14:39 |
| *** rcarrillocruz has joined #openstack-infra | 14:40 | |
| fungi | joa: seen https://wiki.openstack.org/wiki/Gerrit_Workflow ? | 14:40 |
| *** chuckC has quit IRC | 14:40 | |
| joa | yup, might need to refresh my memory though | 14:40 |
| *** jistr has quit IRC | 14:40 | |
| fungi | we write a tool called git-review which tries to automate and simplify submitting patches to gerrit as much as possible. that wiki talks about it at length | 14:41 |
| *** Sukhdev has joined #openstack-infra | 14:41 | |
| joa | used it once currently, to submit a spec for cinder :) | 14:41 |
| *** zz_gondoi is now known as gondoi | 14:41 | |
| fungi | cool! | 14:41 |
| *** rcarrill` has quit IRC | 14:41 | |
| joa | I just don't know how to name the branches out of my mind yet | 14:41 |
| joa | for cinder it was to be related with the blueprint so it was easy enough | 14:42 |
| fungi | i usually just pick an arbitrary branch name for my local topic branch when writing a patch for something. and then typically delete that once i send it to review. the topic names aren't terribly important in most cases | 14:43 |
| joa | okay. | 14:43 |
| joa | well, works for me, if most of the cases it has no impact | 14:43 |
| *** che-arne has quit IRC | 14:44 | |
| fungi | if you're writing a patch in reference to a blueprint or bug report and mention it with an appropriate header in the commit message, we even have hooks which automagically reset the topic name in gerrit to bp/something or bug/something | 14:44 |
| fungi | so you generally don't have to worry about the topic much | 14:44 |
| joa | oh okay | 14:44 |
| joa | good then | 14:44 |
| *** salv-orlando has quit IRC | 14:44 | |
| joa | I like automagic things | 14:45 |
| fungi | also, the new version of gerrit we're running lets you edit the topic separately from pushing a change, via api or webui, so it's easily corrected if needed | 14:45 |
| *** dizquierdo has quit IRC | 14:45 | |
| *** zz_dimtruck is now known as dimtruck | 14:46 | |
| joa | I remember DuncanT and anteaya checking that for an issue in cinder | 14:47 |
| openstackgerrit | A change was merged to openstack-infra/config: Give PTLs permission to create branches https://review.openstack.org/104663 | 14:48 |
| *** datsun180b has joined #openstack-infra | 14:49 | |
| *** salv-orlando has joined #openstack-infra | 14:49 | |
| *** jistr has joined #openstack-infra | 14:49 | |
| *** bnemec is now known as beekneemech | 14:51 | |
| openstackgerrit | A change was merged to openstack-infra/config: Removing unused jenkins_slave script https://review.openstack.org/104642 | 14:51 |
| *** david-lyle has joined #openstack-infra | 14:53 | |
| *** thedodd has joined #openstack-infra | 14:54 | |
| *** ildikov has joined #openstack-infra | 14:54 | |
| *** radez is now known as radez_g0n3 | 14:55 | |
| *** pdmars_ has joined #openstack-infra | 15:02 | |
| *** BobBall is now known as BobBallAway | 15:03 | |
| *** moted has joined #openstack-infra | 15:04 | |
| joa | Strangely, it seems that the job tries to retrieve an inexistant reference in the repository... | 15:04 |
| *** Evgeny has quit IRC | 15:04 | |
| openstackgerrit | A change was merged to openstack/requirements: Add tuskar-ui to projects.txt https://review.openstack.org/103868 | 15:04 |
| *** bknudson has quit IRC | 15:04 | |
| *** tsg has joined #openstack-infra | 15:04 | |
| *** pdmars has quit IRC | 15:04 | |
| fungi | joa: it's possible your job is not trying to retrieve the ref from your zuul merger | 15:05 |
| joa | fungi: zuul is the one doing the merges of the branches for each job, right ? And then jenkins must just connect to that local repo and retrieve the refs ? | 15:05 |
| joa | yup, I configured the review.o.o repository, originally. but if it must use zuul's... | 15:05 |
| fungi | joa: zuul provides parameters which show up in the job's calling environment, including the ref and url to use for checkout | 15:05 |
| joa | then it's another talk :D | 15:05 |
| joa | yeah, I had set the ZUUL_COMMIT and another one | 15:06 |
| fungi | that's the reason the zuul merger exists. it calculates and serves a special git reference for you to pull into your worker's git clone | 15:06 |
| joa | might have been mistaken on some config | 15:06 |
| fungi | ZUUL_URL is the parameter which tells you the merger url to use (it's a parameter because zuul is designed to potentially coordinate a farm of multiple mergers on separate machines if needed) | 15:07 |
| joa | so I must set ${ZUUL_URL} in the repo ? | 15:07 |
| joa | okaay that's the point wher eI was wrong. | 15:07 |
| fungi | joa: you might want to use this script (it's what we use)... http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/slave_scripts/gerrit-git-prep.sh | 15:08 |
| joa | where do you use/set it ? | 15:08 |
| fungi | we wrap it in this jjb macro (at the top of the macros.yaml) http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/macros.yaml | 15:09 |
| joa | andd that must be part of the slave's configuration; not the master's, right ? | 15:10 |
| *** xianghui has joined #openstack-infra | 15:10 | |
| fungi | then you can just add it as one of the first builders in your job definition, for example http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/infra-publications.yaml#n8 | 15:10 |
| fungi | that script needs to be on the slave (we use puppet to put it on our slave snapshot images ahead of time, but you just need some way of getting it onto the worker before being called) | 15:11 |
| openstackgerrit | A change was merged to openstack-dev/pbr: Remove mirror testing from the integration script https://review.openstack.org/106125 | 15:12 |
| openstackgerrit | A change was merged to openstack/requirements: Fix the requirements for a django library https://review.openstack.org/106059 | 15:12 |
| joa | Mhh I will need to actually redo a few things I think, in the end. | 15:12 |
| joa | if only to have the deployment tools with it | 15:12 |
| fungi | most of our job and job-template definitions you'll find in http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/ start off calling our gerrit-git-prep builder macro | 15:13 |
| joa | lemme check what I currently have within my conf | 15:13 |
| fungi | that gets the workspace set up with the appropriate change already checked out, as built by your zuul merger | 15:13 |
| joa | mhh only have the devstack checkout, and log-related macros | 15:14 |
| fungi | that way the rest of your job can just assume the right commit is in place, and you don't have to worry about using separate mechanisms like the jenkins git plugin or anything | 15:14 |
| *** ihrachyshka has quit IRC | 15:15 | |
| *** chandankumar has quit IRC | 15:15 | |
| joa | I wonder if the openstack-infra repository could have some "up-to-date ready-scripts and configurations" for 3rd party CI deployments | 15:15 |
| openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: Add cross-project unit tests for oslo libraries https://review.openstack.org/85487 | 15:15 |
| fungi | oh, if you're running devstack-gate based jobs, it has a similar mechanism already built into the devstack-gate workspace setup | 15:15 |
| joa | well, not yet. But planned to. | 15:15 |
| joa | since I shall CI two cinder drivers, in the end | 15:15 |
| *** reed has joined #openstack-infra | 15:15 | |
| *** dims_ has quit IRC | 15:16 | |
| fungi | devstack-gate's is like a very complicated extension of gerrit-git-prep which handles making sure all the other projects you're running integration tests with are also checked out to the appropriate branches (or zuul refs too in the case of dependent pipelines like our gate, but that's less of a concern for third-party ci i think) | 15:16 |
| dhellmann | jeblair, fungi, clarkb, sdague : when you have a few minutes, I would appreciate feedback on ^^, esp. w.r.t. test job proliferation for some of the more widely used libraries | 15:16 |
| dhellmann | mordred: you, too, if you have time today ^^ | 15:16 |
| joa | fungi: Well, if I could easily, I'd love to have a similar setup to the Openstack infra, with only the few required jobs enabled. | 15:17 |
| anteaya | joa: improving tooling for third party ci systems is part of the stated goals of the third party meeting | 15:18 |
| joa | but easily is a term really.. simple for my situation :D | 15:18 |
| anteaya | in terms of "who should be working on that" the answer is the third party ci group | 15:18 |
| *** adrian_otto has quit IRC | 15:19 | |
| joa | sure | 15:19 |
| anteaya | joa: https://wiki.openstack.org/wiki/Meetings/ThirdParty#Goals_for_Third_Party_meetings | 15:19 |
| *** bknudson has joined #openstack-infra | 15:20 | |
| joa | I guess it's hard to cover too much in just one hour | 15:21 |
| anteaya | jeblair: we have a line up of +1's and two +2's on the patch about ensuring third party ci's don't comment on certain repos, I really would like to have your input before it merges: https://review.openstack.org/#/c/102581/ | 15:21 |
| anteaya | joa: yes it is | 15:21 |
| anteaya | but the meetings can track progress of what needs to be addressed and who will work on it | 15:21 |
| *** elambert has joined #openstack-infra | 15:21 | |
| *** markwash has quit IRC | 15:22 | |
| jeblair | dhellmann: that's about how many jobs a devstack-gate change triggers :/. it's not ideal, but i think it's within the bounds of reason and what we expected when we discussed it at the summit | 15:22 |
| anteaya | the meetings serve as a discussion so common goals can be identifyed | 15:22 |
| anteaya | and work divided up | 15:22 |
| anteaya | joa: please add an item to next week's third party meeting agenda to discuss your goals | 15:22 |
| anteaya | that way we ensure it gets some discussion time | 15:22 |
| dhellmann | jeblair: yeah, I'm not thrilled with the resource consumption. :-/ I considered managing the list manually to projects either with known issues or that we know exercise a library particularly well, but I wanted to look at what the full matrix looked like first. | 15:23 |
| *** sabeen1 has joined #openstack-infra | 15:24 | |
| *** dimtruck is now known as zz_dimtruck | 15:24 | |
| joa | Well, I might not make it to the two next meetings sadly | 15:24 |
| anteaya | joa: okay that is fair | 15:24 |
| anteaya | can you add it to an agenda in future? | 15:25 |
| joa | unless I can put up a subject and leave discussion to you, but it does not seem quite fair to me | 15:25 |
| anteaya | no, it won't have your input | 15:25 |
| jeblair | anteaya: hrm, i think i mentioned this when you first proposed this, but i don't like the idea of an exclusion list. i think third-party ci folks should either be invited or should ask projects if they would be welcome first. | 15:25 |
| joa | mhh I could, where should I add it ? | 15:25 |
| anteaya | it works best if you kick off the discussion if it is your agenda item | 15:25 |
| jeblair | anteaya: having said that, if you think the list is necessary, it should include "openstack-infra/*" | 15:25 |
| *** nati_ueno has joined #openstack-infra | 15:25 | |
| anteaya | jeblair: I can make that change | 15:25 |
| anteaya | I do like introducing the policy of ask first | 15:26 |
| anteaya | but it will be a new policy since we don't have that yet | 15:26 |
| jeblair | anteaya: i'm not so sure | 15:26 |
| anteaya | I'm listening | 15:26 |
| jeblair | anteaya: the projects that have the bulk of third party systems already have asked | 15:26 |
| krtaylor | joa, yes, please add agenda item, we'll discuss, I believe I am chairing the meeting next week | 15:26 |
| jeblair | anteaya: they issued policies like "if you want your driver code in, you have to run a ci system" | 15:26 |
| jeblair | anteaya: i consider that an open invitation | 15:26 |
| anteaya | asked to comment, before adding repos to their testing system? | 15:27 |
| joa | krtaylor: I was just saying I'd not be here :D | 15:27 |
| fungi | dhellmann: the explosive job matrix additions are on projects which receive far fewer changes/patchsets though (i think) and as such should contribute appreciable additional overall load | 15:27 |
| anteaya | krtaylor: yes please | 15:27 |
| krtaylor | joa, nm, I just saw you wouldnt be there | 15:27 |
| joa | ^^ | 15:27 |
| anteaya | jeblair: ah yes, that is true | 15:27 |
| krtaylor | joa, join us when you can | 15:27 |
| fungi | s/should/shouldn't/ | 15:27 |
| anteaya | jeblair: but testing devstack? | 15:27 |
| joa | thing is the time isn't quite practical for me, but I can still arrange to be at a few meetings | 15:27 |
| anteaya | someone was testing devstack and mtreinish didn't know why | 15:27 |
| *** garyk has quit IRC | 15:28 | |
| anteaya | jeblair: so that person had not asked mtreinish prior to commenting on devstack patches | 15:28 |
| openstackgerrit | afazekas proposed a change to openstack-infra/config: iptables on fedora https://review.openstack.org/106402 | 15:28 |
| jeblair | anteaya: yeah, would have been nice if they did :) | 15:28 |
| anteaya | right | 15:28 |
| dhellmann | fungi: good point, and that'll be true for libs like oslo.i18n and oslo.config, but less for oslo.messaging and oslo.db, where I expect more opportunities for breaking changes, so we want those tests anyway | 15:28 |
| joa | anteaya: krtaylor: Should I add it for a "pending subjects for future meetings" ? | 15:28 |
| anteaya | that is the case I am trying to address | 15:28 |
| joa | this way if someone wants to take up the subject, it can still be done ? | 15:28 |
| anteaya | and I do think that governance should never have third party ci comments | 15:28 |
| anteaya | joa: you can, sure | 15:29 |
| *** trinaths has joined #openstack-infra | 15:29 | |
| krtaylor | anteaya, I am still planning on having a meeting, although it may be sparse due to mid-cycle | 15:30 |
| *** IvanBerezovskiy has left #openstack-infra | 15:30 | |
| krtaylor | joa, yes please | 15:30 |
| anteaya | krtaylor: oh yes, please, I have been counting on you having a meeting | 15:30 |
| anteaya | and mestery is working on an email to flag errant systems instructing them to show up on monday | 15:30 |
| anteaya | so actually you might (hopefully) have a bit of a crowd | 15:30 |
| mestery | anteaya: ++ | 15:30 |
| krtaylor | jeblair, anteaya re: devstack testing, powerkvm needs to test these components and report on them, they are frequently the worst offenders for doing something platform specific | 15:31 |
| anteaya | I don't quite understand the point of your last statement yet krtaylor | 15:31 |
| anteaya | can you try me again? | 15:31 |
| krtaylor | mestery, excellent, and you'll be there I presume? :) | 15:31 |
| krtaylor | anteaya, I don't think we should list components that shouldnt be commented on | 15:32 |
| anteaya | krtaylor: help me understand why? | 15:32 |
| *** Guest65545 has quit IRC | 15:33 | |
| krtaylor | anteaya, because if we find problems, it is easier to get the fix in before merge | 15:33 |
| fungi | i'm guessing the point was that some developers have an interest in providing feedback on whether devstack changes will break its ability to run on powerkvm? | 15:33 |
| *** marun has joined #openstack-infra | 15:33 | |
| *** annegentle has joined #openstack-infra | 15:33 | |
| krtaylor | anteaya, and with a new platform, there are usually assumptions made about the existing platforms | 15:33 |
| fungi | is there powerkvm-specific support in devstack itself? | 15:34 |
| anteaya | krtaylor: help me understand why your system should ever be allowed to comment on the governance repo | 15:34 |
| krtaylor | fungi, exactly | 15:34 |
| *** annegentle is now known as Guest34291 | 15:34 | |
| *** Guest34291 is now known as gentleanne | 15:34 | |
| krtaylor | fungi, no specific, but fixes that were made to be more general to work cross-platform | 15:34 |
| *** obondarev has joined #openstack-infra | 15:34 | |
| *** otherwiseguy has joined #openstack-infra | 15:34 | |
| anteaya | krtaylor: if you are wanted to test devstack, do you feel it would be appropriate to request permission from the qa ptl prior to doing so? | 15:34 |
| krtaylor | anteaya, ok, that is a good example | 15:35 |
| *** signed8bit has joined #openstack-infra | 15:35 | |
| anteaya | krtaylor: okay so we can agree that governance should never have third party ci comments | 15:35 |
| krtaylor | anteaya, absolutely not, that would be a given | 15:35 |
| krtaylor | anteaya, well it should be a given | 15:35 |
| krtaylor | yes, governance is good :) | 15:35 |
| anteaya | okay, if that is our only repo then I am willing to edit the patch to reflect that | 15:35 |
| anteaya | and other repos we agree on | 15:36 |
| krtaylor | anteaya, yes, and I should be flogged for not reviewing yet | 15:36 |
| anteaya | and currently we don't agree that devstack-gate belongs in that list | 15:36 |
| mestery | krtaylor: Yes, I'll be tehre! | 15:36 |
| krtaylor | mestery, perfect | 15:36 |
| anteaya | krtaylor: no, I'm too tired of flogging, you don't even make my list | 15:36 |
| krtaylor | hehheh | 15:36 |
| * krtaylor heads to reviews | 15:37 | |
| joa | anteaya: krtaylor: http://paste.openstack.org/show/86124/ Does it sound too much for a meeting's subject ? I might have been too detailed there, but at least I won't forget. | 15:38 |
| *** gangil has joined #openstack-infra | 15:39 | |
| *** jaypipes has quit IRC | 15:39 | |
| anteaya | jeblair: do you agree that governance should not have third party ci comments on it? | 15:41 |
| anteaya | joa: a bit much for an agenda | 15:41 |
| anteaya | I suggest lines 1-3 and then a link to this paste | 15:42 |
| jeblair | anteaya: of course it should not | 15:42 |
| krtaylor | joa, some of that is already covered, but we could improve pointing to good sources of information | 15:42 |
| anteaya | jeblair: great, so I'll change the patch to just list the governance repo? | 15:43 |
| jeblair | anteaya: huh, what why? | 15:43 |
| anteaya | and we can merge that? | 15:43 |
| anteaya | why document that the governance repo shouldn't have third party comments on it? | 15:43 |
| jeblair | anteaya: that seems to suggest that's the only repo third party systems may not comment on, which is not the case | 15:43 |
| fungi | i think the "which third parties are allowed to submit verify votes" issue is already fairly settled. as to which are allowed to post comments, filtering of those comments (such as with jeblair's toggle) seems a more relevant solution that adding more bureaucratic policy | 15:43 |
| *** xianghui has quit IRC | 15:44 | |
| anteaya | https://review.openstack.org/#/c/98675/ | 15:44 |
| fungi | s/that/than/ | 15:44 |
| jeblair | anteaya: it _is_ the case that third party systems are only permitted to comment on repos if their projects (as represented by their ptls) want it | 15:44 |
| anteaya | a governance patch with a third party ci comment on it | 15:44 |
| openstackgerrit | Lance Bragstad proposed a change to openstack-infra/elastic-recheck: Amend e-r for bug 1286818 https://review.openstack.org/106410 | 15:44 |
| uvirtbot | Launchpad bug 1286818 in openstack-ci "Ubuntu mirror periodically inconsistent causing gate build failures" [Low,Triaged] https://launchpad.net/bugs/1286818 | 15:44 |
| anteaya | jeblair: okay, well that isn't documented | 15:44 |
| jeblair | anteaya: it's understood | 15:45 |
| anteaya | jeblair: and not known that that is the case amoung the ci or the ptls | 15:45 |
| fungi | anteaya: that seems like a misconfiguration to me. i'm not sure adding policy is going to stop people from misconfiguring their systems | 15:45 |
| *** dims_ has joined #openstack-infra | 15:45 | |
| anteaya | jeblair: you understand it | 15:45 |
| anteaya | fungi: sure it is | 15:45 |
| joa | anteaya: alright for the link to paste. krtaylor: I'll leave it in the paste, it will be a good reminder to add the proper pointers for the parts that are already done/present/existing/up-to-date. | 15:45 |
| *** jlibosva has quit IRC | 15:45 | |
| anteaya | but how to communicate that | 15:45 |
| anteaya | I guarentee the third party ci folks don't have that understanding | 15:46 |
| jeblair | anteaya: yeah, i know why you're doing this | 15:46 |
| krtaylor | joa, please add the link to the wiki agenda for the next meeting | 15:46 |
| anteaya | jeblair: so if we don't like my approach that is fine, I can abandon | 15:46 |
| krtaylor | joa, and lets discuss and assign actions :) | 15:46 |
| anteaya | but I do feel we need something since I am feeling there is a gap | 15:46 |
| jeblair | anteaya: what i don't understand is why you decided to drop openstack-infra/* from the exclusion list | 15:46 |
| anteaya | and I would like to close it | 15:47 |
| * krtaylor needs to find time to address his actions | 15:47 | |
| anteaya | jeblair: oh | 15:47 |
| anteaya | did I drop it, I don't know as it was ever in the patch | 15:47 |
| *** rlandy has quit IRC | 15:47 | |
| jeblair | 15:43 < anteaya> jeblair: great, so I'll change the patch to just list the governance repo? | 15:47 |
| joa | krtaylor: Sure, I don't plan to assign or validate actions myself, those are just my ideas as of now :) | 15:47 |
| fungi | educating people on why they're commenting on changes and how to identify appropriate changes to comment on seems more likely to work out than just adding larger and larger bodies of laws on what you can't comment on | 15:47 |
| openstackgerrit | Brianna Poulos proposed a change to openstack/requirements: Add python-barbicanclient https://review.openstack.org/106411 | 15:48 |
| anteaya | jeblair: oh because some folks want to be able to test devstack | 15:48 |
| jeblair | anteaya: devstack is not in openstack-infra | 15:48 |
| jeblair | anteaya: i am not its ptl | 15:48 |
| anteaya | but I can edit the patch to include openstack-infra/* and not just devstack-gate | 15:48 |
| anteaya | jeblair: k | 15:48 |
| jeblair | anteaya: i am not weighing in on whether people test devstack | 15:49 |
| jeblair | anteaya: devstack-gate is in infra | 15:49 |
| anteaya | jeblair: fair enough | 15:49 |
| fungi | operators who don't know how to identify the right projects to put in their configuration likely also are just copy/pasting configuration from somewhere else that they don't understand anyway, so a punitive policy telling them it's wrong isn't much help if they don't know what they configured to begin with | 15:49 |
| jeblair | anteaya: third party systems are not welcome to comment on it | 15:49 |
| *** salv-orlando has quit IRC | 15:49 | |
| anteaya | fungi: I agree with that | 15:49 |
| *** pdmars_ has quit IRC | 15:49 | |
| anteaya | jeblair: great | 15:49 |
| * anteaya respins to state openstack-infra/* | 15:50 | |
| *** nati_ueno has quit IRC | 15:50 | |
| * joa notes that he tried to avoid that, but may risk to be part of those who would do it (refering to fungi) | 15:50 | |
| krtaylor | fungi, sadly, that is true | 15:51 |
| jeblair | anteaya: why do you prefer the exclusion list as opposed to text explaining that operators should consult with the teams whose projects they want to leave votes on? | 15:51 |
| fungi | joa: well, point being you wouldn't know that you were violating that policy until someone told you to stop | 15:51 |
| joa | sure. | 15:51 |
| krtaylor | anteaya, did you mean to post https://review.openstack.org/#/c/102581/ instead of 98675? | 15:52 |
| anteaya | jeblair: I don't, I want both | 15:52 |
| clarkb | fungi: sdague the osloganalyze issue was the old python package install problem. git was up to date, latest git version was installed but pip freeze reported an older version. So we seemed to have a mixed package which broke internal api contracts | 15:52 |
| jeblair | anteaya: fair enough :) | 15:52 |
| krtaylor | wait, comments, or votes? | 15:52 |
| clarkb | also https://bitbucket.org/pypa/bandersnatch/issue/47/simple-index-synced-for-package-after happened | 15:52 |
| anteaya | jeblair: I just would like the list first, in case another ci comments on governance | 15:52 |
| clarkb | I am not thrilled with the response I got | 15:52 |
| fungi | clarkb: yeah, having seen it break like that before, it seems like it has to be something failing partway into the exec rather than with the vcsrepo module | 15:53 |
| krtaylor | IMHO, comments should be allowed if cleared with the ptl, votes on -infra never | 15:53 |
| anteaya | krtaylor: I posted the goverance patch to show the third party ci comment on it | 15:53 |
| *** dstanek is now known as dstanek_zzz | 15:53 | |
| *** changbl has joined #openstack-infra | 15:54 | |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Creates a list of no-test repositories https://review.openstack.org/102581 | 15:54 |
| joa | anteaya: krtaylor: Was cleaning my addition, but now it's up, if you want to check | 15:55 |
| krtaylor | anteaya, see above IMHO :) | 15:56 |
| jeblair | anteaya: where's the part where you clarify that comments are also at the discretion of the ptl? | 15:56 |
| *** nati_ueno has joined #openstack-infra | 15:56 | |
| *** dhellman_ has joined #openstack-infra | 15:57 | |
| jeblair | clarkb: eventually consistent is awesome! that means you can eventually install our software! and eventually run it! | 15:57 |
| rcarrillocruz | zaro: hi, are you around? | 15:58 |
| clarkb | jeblair: indeed! I am actually fine with eventually consistent. You can be eventually consistent without being broken | 15:58 |
| clarkb | I am going to write a response | 15:58 |
| *** jgallard has quit IRC | 15:58 | |
| *** matrohon has quit IRC | 15:58 | |
| jeblair | clarkb: agreed, the conservative approach is also eventually consistent, will be correct in the same amount of time, and is never broken | 15:59 |
| clarkb | yup :) | 15:59 |
| *** dustins has quit IRC | 16:00 | |
| *** isviridov is now known as isviridov|away | 16:01 | |
| *** dhellman_ has quit IRC | 16:01 | |
| clarkb | I think the most annoying thing is "404s can't be prevented in any way" | 16:02 |
| *** dhellman_ has joined #openstack-infra | 16:02 | |
| *** _nadya_ has joined #openstack-infra | 16:03 | |
| *** chandankumar has joined #openstack-infra | 16:03 | |
| *** afazekas has quit IRC | 16:04 | |
| fungi | i updated it asking whether that design "simplicity" is integral to the mission of bandersnatch, or whether fixes would be considered if provided | 16:05 |
| reed | ttx, does the release management team have a bug tracker? where? | 16:05 |
| clarkb | fungi: ok I think you covered what I was going to say | 16:06 |
| clarkb | with one exception /me leaves that as a note | 16:06 |
| fungi | i've managed many, many mirrors of things in the past, and one basic design most mirror algorithms have in common is that you update the index after successfully mirroring the things you're indexing | 16:06 |
| *** gentleanne has quit IRC | 16:07 | |
| *** arnaud has joined #openstack-infra | 16:07 | |
| *** hashar has quit IRC | 16:07 | |
| *** yamahata has quit IRC | 16:07 | |
| ttx | reed: no bug tracker | 16:07 |
| reed | ttx, k, thanks | 16:07 |
| *** _nadya_ has quit IRC | 16:07 | |
| clarkb | fungi: yup | 16:08 |
| anteaya | jeblair: I haven't clarified that, but I can add that | 16:09 |
| *** e0ne has joined #openstack-infra | 16:09 | |
| *** cody-somerville has joined #openstack-infra | 16:09 | |
| anteaya | jeblair: are you likely to allow third party ci systems to comment on openstack-infra/* ? | 16:10 |
| anteaya | I'm going with ttx will never allow it for governance | 16:10 |
| jeblair | anteaya: not likely | 16:10 |
| clarkb | for the record I was able to fix the proble by issuing a purge against the stale url noted in the bandersnatch log | 16:10 |
| clarkb | this synced the whl making the simple index page for python-novaclient correct | 16:11 |
| anteaya | jeblair: but I can add that to this patch if you would like | 16:11 |
| openstackgerrit | Andreas Jaeger proposed a change to openstack-infra/config: Fix transifex project names https://review.openstack.org/106427 | 16:11 |
| jeblair | anteaya: that one or a new one would be nice. | 16:11 |
| anteaya | jeblair: the section on requesting ptl permisson prior to commenting on repos is a seperate patch I haven't created yet | 16:11 |
| anteaya | yes, a different patch | 16:11 |
| jeblair | clarkb: i think we may need a mirror page on ci.openstack.org, to document when/how we purge at the least | 16:12 |
| clarkb | jeblair: ok, I will write that up now | 16:12 |
| *** luqas has quit IRC | 16:12 | |
| *** dhellman_ has quit IRC | 16:12 | |
| clarkb | jeblair: do you want a dedicated page or a section under the rooters page? | 16:13 |
| *** dkliban is now known as dkliban_afk | 16:13 | |
| mordred | clarkb: ugh. just read bandersnatch bug | 16:14 |
| clarkb | mordred: you know people wonder why we cook up tools like pypi-mirror | 16:14 |
| *** Guest58876 has quit IRC | 16:14 | |
| mordred | clarkb: I'm ... I mean | 16:14 |
| clarkb | mordred: what we need is a catalog of things like this :) | 16:14 |
| mordred | clarkb: a) AFS | 16:14 |
| mordred | clarkb: b) ugh | 16:14 |
| clarkb | mordred: AFS won't solve this problem unfortunately | 16:15 |
| clarkb | it is a very rare example of a problem that afs does not solve | 16:15 |
| jeblair | clarkb: i think we need a bandersnatch page | 16:15 |
| clarkb | jeblair: ok | 16:15 |
| mordred | clarkb: sure it will - don't publish the volume unless there were no errros | 16:15 |
| Ajaeger | jeblair, fungi, clarkb: Could you review and approve https://review.openstack.org/106427, please? I missed to change one place and it's needed to send oslo.* translations to transifex | 16:15 |
| *** asettle has joined #openstack-infra | 16:15 | |
| mordred | clarkb: but we can simulate that | 16:15 |
| ttx | mordred: so which world cup game did you end up seeing ? ARG-NED? | 16:16 |
| mordred | clarkb: although it might double the footprint | 16:16 |
| *** Ryan_Lane has joined #openstack-infra | 16:16 | |
| mordred | clarkb: if we mirror to one dir, and then rsync to a different dir - but only run the rsync on fully successful runs taht don't have anything stale | 16:16 |
| mordred | clarkb: and we do the thing where we catch stale entries and issue the purge | 16:17 |
| clarkb | mordred: I think you are over thinking this | 16:17 |
| mordred | oh - ok. | 16:17 |
| mordred | great | 16:17 |
| clarkb | mordred: if I go sit down to write a bandersnatch patch this will come out to probably <50 lines of code | 16:17 |
| mordred | clarkb: it didn't sound like upstream was interested in solving this problem | 16:17 |
| clarkb | just need to bucket artifacts for packages to gether and treat that as a sync unit | 16:17 |
| jeblair | mordred: don't vos release until there are no errors | 16:17 |
| clarkb | well maybe they can be convinced | 16:18 |
| mordred | jeblair: right | 16:18 |
| mordred | jeblair: that's EXACTLY what I was thinking | 16:18 |
| *** marun has quit IRC | 16:18 | |
| clarkb | I might be getting ahead of myself but using mirror softawre that does not preserve correctness is just wrong | 16:18 |
| clarkb | and hopefully upstream can understand that | 16:19 |
| mordred | clarkb: if you can fix it in bandersnatch, I'm all for it -and if we have to run a fork if upstream doesn't want the patch, I'm also ok with that | 16:19 |
| clarkb | I mean this is what rackspace is doing to us with apt repos | 16:19 |
| mordred | clarkb: however, I also think the hack of "rsync to prod IFF mirror run successful" would be easy to do | 16:19 |
| clarkb | and our resposne to that is well we won't use your stuff then | 16:19 |
| *** markwash has joined #openstack-infra | 16:19 | |
| mordred | clarkb: yah | 16:19 |
| mordred | I kinda want to make a good and stable set of mirrors for all fo the things | 16:20 |
| mordred | clarkb, jeblair: also, https://review.openstack.org/#/c/104574/ | 16:22 |
| mordred | that's the patch to find and respond to stale packages automatically | 16:22 |
| *** dstanek_zzz is now known as dstanek | 16:22 | |
| clarkb | mordred: but it will leave us open to 404s for 5 minutes right? | 16:22 |
| mordred | yes | 16:23 |
| clarkb | (still better than current istuation, just want to make sure I understand) | 16:23 |
| mordred | not saying it's the solution | 16:23 |
| mordred | just that it's a brick in the wall | 16:23 |
| clarkb | ya | 16:23 |
| clarkb | mordred: I take it you tested that because that run-bandersnatch script was in the bandersnatch log dir | 16:23 |
| jeblair | mordred: 2x+2, but did not aprv | 16:24 |
| *** mriedem has quit IRC | 16:24 | |
| clarkb | I am +2 as well, can approve if you tested it, otherwise one of us should probably do that | 16:24 |
| fungi | well, the fix to bandersnatch consistency will likely mean that bandersnatch gets stale until the purge call to fastly happens, but automating the purge call based on bandersnatch run results gives us a one-two punch to get things back up to date quickly | 16:24 |
| clarkb | fungi: yup | 16:25 |
| fungi | and not broken in the interim | 16:25 |
| *** e0ne has quit IRC | 16:26 | |
| *** e0ne has joined #openstack-infra | 16:26 | |
| mordred | clarkb: well, I tested that it works works - testing that it dose the right thing when it detects a stale package mildly harder | 16:26 |
| *** marcoemorais has joined #openstack-infra | 16:26 | |
| mordred | clarkb: but I'll land and babysit | 16:27 |
| clarkb | mordred: cool | 16:27 |
| *** arnaud has quit IRC | 16:27 | |
| *** rcarrill` has joined #openstack-infra | 16:27 | |
| *** pdmars has joined #openstack-infra | 16:28 | |
| *** pcm_ has quit IRC | 16:28 | |
| *** marun has joined #openstack-infra | 16:28 | |
| *** pcm_ has joined #openstack-infra | 16:28 | |
| *** bdpayne has joined #openstack-infra | 16:29 | |
| fungi | mordred: jeblair: clarkb: any general objections to an update to our tox-oriented slave scripts to call it with -v -v for additional debugging output about what tox is doing? i'm hoping that will help track down failures like bug 1282795 and bug 1331938 | 16:29 |
| uvirtbot | Launchpad bug 1282795 in openstack-ci "InterpreterNotFound: python2.6" [Low,Confirmed] https://launchpad.net/bugs/1282795 | 16:29 |
| uvirtbot | Launchpad bug 1331938 in openstack-ci "pypy InterpreterNotFound in gate-python-ceilometerclient-pypy job (dup-of: 1282795)" [Undecided,New] https://launchpad.net/bugs/1331938 | 16:29 |
| *** rcarrillocruz has quit IRC | 16:29 | |
| mordred | fungi: isn't all of that output in the .tox dir in log files too? | 16:30 |
| *** arnaud has joined #openstack-infra | 16:30 | |
| fungi | oh, perhaps. i didn't think to go digging in there. i'll check | 16:30 |
| mordred | like, we could just save teh .tox logs so it doesn't make the console output chattier? | 16:30 |
| mordred | otherwise, fine by me | 16:30 |
| fungi | no, i agree with you. if that's in the tox logfiles we should just add those to our collection list | 16:31 |
| jeblair | faster too | 16:31 |
| fungi | yep | 16:31 |
| *** pcm_ has quit IRC | 16:31 | |
| fungi | no need to wait for image rebuilds | 16:31 |
| fungi | double-checking that theory now, but patch inbound if it's got the same detail i was getting from -v -v | 16:32 |
| *** pcm_ has joined #openstack-infra | 16:32 | |
| *** praneshp has joined #openstack-infra | 16:32 | |
| fungi | harumph. i get an empty .tox/log directory | 16:33 |
| *** sballe has joined #openstack-infra | 16:34 | |
| fungi | oic, it's in .tox/env/log/env-*.log | 16:34 |
| jeblair | yeah | 16:34 |
| *** yfried__ has quit IRC | 16:34 | |
| *** _nadya_ has joined #openstack-infra | 16:34 | |
| Kiall | FYI - Just got this from http://www.openstack.org/summit ... [Warning] mysql_connect() [function.mysql-connect]: User 506635_oslive already has more than 'max_user_connections' active connections | 16:34 |
| Kiall | mysql_connect(<filtered>,<filtered>,<filtered>,<filtered>) <-- Smart ;) | 16:35 |
| fungi | so i guess i can just 'mv .tox/env/log tox' and then collect the "tox" dir or something | 16:35 |
| fungi | Kiall: please contact todd@openstack.org about that. not a good situation at ALL | 16:36 |
| *** timrc-afk is now known as timrc | 16:37 | |
| *** sweston_ has joined #openstack-infra | 16:37 | |
| *** pcm_ has quit IRC | 16:37 | |
| *** pcm_ has joined #openstack-infra | 16:37 | |
| *** harlowja_away is now known as harlowja | 16:37 | |
| *** hogepodge has joined #openstack-infra | 16:37 | |
| Kiall | fungi: just to confirm - the error page showed "<filtered>" in place of the creds, in case you thought I filtered them myself! Should I still contact him about the mysql conn limit error anyway? | 16:38 |
| fungi | jbryce: ^ you probably also want to know, if you happen to be around | 16:38 |
| fungi | Kiall: oh! at least it's filtered behind the ui (i was worried you were redacting it for the benefit of the irc logs) | 16:38 |
| fungi | Kiall: in that case i'd say just open a bug against openstack-org to give them a heads up | 16:38 |
| Kiall | Yea, I realized that as you said it :) The "Smart" comment was about the fact that it was actually filtered properly! | 16:39 |
| Kiall | I've seen lots of sites spew the connection details that way | 16:39 |
| fungi | right, standing down paranoid delusions of imminent security breach now | 16:39 |
| fungi | eminent | 16:39 |
| jbryce | Kiall, fungi: i let todd know | 16:39 |
| *** jgrimm has quit IRC | 16:40 | |
| fungi | jbryce: thanks! sounds like we're probably just getting overloaded (hopefully) | 16:40 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Document use of bandersnatch for pypi mirroring https://review.openstack.org/106431 | 16:40 |
| clarkb | jeblair: mordred fungi ^ | 16:40 |
| Kiall | fungi / jbryce - https://bugs.launchpad.net/openstack-org/+bug/1340839 | 16:41 |
| uvirtbot | Launchpad bug 1340839 in openstack-org "User 506635_oslive already has more than 'max_user_connections' active connections" [Undecided,New] | 16:41 |
| *** Sukhdev has quit IRC | 16:41 | |
| fungi | i guess i used the right imminent the first time. i need to stop mixing those up | 16:41 |
| jeblair | nibalizer: i just attempted a launch of puppetmaster on trusty: | 16:41 |
| jeblair | puppet agent --environment production --server ci-puppetmaster.openstack.org --no-daemonize --verbose --onetime --pluginsync true --certname puppetmaster.openstack.org | 16:41 |
| jeblair | Notice: Skipping run of Puppet configuration client; administratively disabled (Reason: 'Disabled by default on new installations'); | 16:41 |
| openstackgerrit | Flavio Percoco proposed a change to openstack-infra/config: Create the glance.store repo https://review.openstack.org/106361 | 16:41 |
| clarkb | I am thinking the line number link to static.pp is not actually a good thing as it will drift over time | 16:42 |
| *** pcm_ has quit IRC | 16:42 | |
| clarkb | but curious to know what others thing | 16:42 |
| clarkb | *think | 16:42 |
| *** pcm_ has joined #openstack-infra | 16:42 | |
| nibalizer | jeblair: ya i think we added that somewhere | 16:42 |
| nibalizer | basically we need to remove the puppet lock file | 16:42 |
| nibalizer | if you puppet config print all | grep lock | 16:42 |
| nibalizer | you should be able to find its lock file | 16:43 |
| *** pcm_ has quit IRC | 16:43 | |
| jeblair | nibalizer: so the fun thing about this is that once it hits an error, the server is deleted :) | 16:43 |
| jeblair | nibalizer: so the test cycle is "attempt to code a fix, then launch it again" | 16:43 |
| nibalizer | oh | 16:43 |
| *** pcm_ has joined #openstack-infra | 16:43 | |
| nibalizer | i didn't know thats how machines were spun up around these parts | 16:44 |
| jeblair | nibalizer: yeah, first run has to complete without errors | 16:44 |
| nibalizer | so mordred is the person that wrote the patch to admin disable puppet by default iirc let me go poke my head around somewhewe | 16:44 |
| *** Sukhdev has joined #openstack-infra | 16:44 | |
| *** sweston_ has quit IRC | 16:45 | |
| mordred | nibalizer: what did I do? | 16:45 |
| nibalizer | made debian act like redaht | 16:46 |
| nibalizer | so that 'apt-get install puppet' doesn't start services | 16:46 |
| mordred | oh - no, I don't think so - I thnik it'sa new puppet install behavior | 16:46 |
| nibalizer | or maybe i just hallucinated this | 16:46 |
| mordred | you need to edit /etc/default/puppet now I think | 16:46 |
| nibalizer | oh did puppet fix it? | 16:46 |
| mordred | yah | 16:46 |
| nibalizer | jeblair: ^ well there you go | 16:46 |
| jeblair | so, erm, in what situations does this apply? | 16:47 |
| clarkb | mordred: looking at bandersnatch more closely I think this may be a subtle bug. They are already attempting to sync all the files and if that fails the simple page shouldn't be updated https://bitbucket.org/pypa/bandersnatch/src/5885ad40fe476e10ee55d26dc7001b545a420715/src/bandersnatch/package.py?at=default#cl-91 | 16:47 |
| clarkb | mordred: I think that may mean python-novaclient was queued up twice? | 16:47 |
| *** msabramo1 has quit IRC | 16:47 | |
| jeblair | is this happening because it's a new change in trusty? | 16:47 |
| nibalizer | jeblair: i think any installation of new puppet from apt packages | 16:47 |
| mordred | jeblair: yah. new installs of puppet to not start daemons by default | 16:47 |
| jeblair | clarkb: did you have this problem when you spun up new logstash workers? | 16:47 |
| *** sweston_ has joined #openstack-infra | 16:48 | |
| *** dkliban_afk is now known as dkliban | 16:48 | |
| jeblair | i'm trying to understand whether we have fixed this already, and if so, why it doesn't work, and if not, why not? | 16:48 |
| nibalizer | were those on puppet 3? | 16:48 |
| clarkb | jeblair: no because we run puppet agent directly | 16:48 |
| clarkb | jeblair: /etc/default/puppet is just for the daemon | 16:48 |
| *** UtahDave has joined #openstack-infra | 16:48 | |
| mordred | right. just for the puppetmaster daemon | 16:48 |
| nibalizer | so we're back to the lockfile? | 16:48 |
| jeblair | clarkb: i'm spinning up a new node in the usual manner | 16:48 |
| jeblair | 16:41 < jeblair> puppet agent --environment production --server ci-puppetmaster.openstack.org --no-daemonize --verbose --onetime --pluginsync true --certname puppetmaster.openstack.org | 16:48 |
| jeblair | 16:41 < jeblair> Notice: Skipping run of Puppet configuration client; administratively disabled (Reason: 'Disabled by default on new installations'); | 16:48 |
| mordred | oh - hrm | 16:49 |
| nibalizer | mordred: didn't you write a patch to write out those logfiles? | 16:49 |
| nibalizer | er s/log/lock/ | 16:49 |
| *** adrian_otto has joined #openstack-infra | 16:49 | |
| mordred | nibalizer: that was an ansible patch to help with running puppet on disabled servers | 16:49 |
| *** lttrl has quit IRC | 16:49 | |
| mordred | jeblair: I believe I've seen that on recent pupet installs | 16:50 |
| *** armax has joined #openstack-infra | 16:50 | |
| jeblair | mordred: clarkb and i booted new puppet2/precise nodes within the past few months without hitting that | 16:50 |
| Ajaeger | funi, jeblair : Thanks for review and approving! | 16:51 |
| clarkb | jeblair: mordred I wonder if puppet agent checks that file now in newer puppet | 16:51 |
| clarkb | in older puppet only the init script checked | 16:51 |
| *** dims_ is now known as dimsum | 16:51 | |
| clarkb | that would be silly for puppet to check directly... | 16:51 |
| mordred | I believe that is correct | 16:51 |
| jeblair | the _agent_ checks the _default_ file? | 16:51 |
| jeblair | that's insane | 16:52 |
| mordred | no, I think the new install drops in the disable lock file by default now and you need to "puppet agent --enable" | 16:52 |
| jeblair | mordred: where's the message come from? | 16:52 |
| mordred | unsure. /me goes off to check ... I just remember that I've seen this before when installing my laptop | 16:53 |
| mordred | but I didnt' think about it in our terms beacuse I'm stupid | 16:53 |
| *** zz_dimtruck is now known as dimtruck | 16:53 | |
| jeblair | so should we add "puppet agent --enable" to the end of setup_puppet_ubuntu in install_puppet.sh? | 16:54 |
| jeblair | or add it to the launch script? | 16:54 |
| clarkb | ooohhhhhh you know what, I think the bug may be in the pypi sync protocol | 16:54 |
| mordred | jeblair: lemme check something real quick | 16:54 |
| nibalizer | jeblair: are the launch scripts in infra/config ? may I read them? | 16:55 |
| clarkb | 1154164 is the serial we wanted but 1154163 is the serial we got. I think 1154163 may have been go sync python-novaclient sdist | 16:55 |
| jeblair | nibalizer: yes: infra/config/launch | 16:55 |
| clarkb | which worked because we weren't that stale | 16:55 |
| clarkb | then 1154164 was for the whl | 16:55 |
| clarkb | dstufft: ^ am I just completely wrong? | 16:56 |
| clarkb | dstufft: if I am not completely wrong you should only issue a serial for atomic changes to the simple index pages | 16:56 |
| nibalizer | jeblair: so if the agent is disabled via lockfile then this file will exist /var/lib/puppet/state/agent_disabled.lock | 16:56 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Collect tox logs from job runs https://review.openstack.org/106435 | 16:57 |
| nibalizer | mordred: i really thought one of the final steps in our setup-nodes scripting was to drop a puppet lock file down but I don't see it | 16:57 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Collect tox logs from job runs https://review.openstack.org/106435 | 16:58 |
| *** shashankhegde has joined #openstack-infra | 16:58 | |
| jeblair | nibalizer: i did puppet agent --enable in install_puppet and it's running puppet now | 16:58 |
| *** jcoufal-mobile_ has quit IRC | 16:59 | |
| clarkb | so it seems like puppet is conflacting /etc/default/puppet values with its own internal lock files | 16:59 |
| jeblair | (we can decide if that's the right/wrong place for that later; just wanted to see if the solution worked) | 16:59 |
| clarkb | that is bonghits | 16:59 |
| jeblair | nibalizer: http://paste.openstack.org/show/86130/ | 17:00 |
| mordred | jeblair: ok. yes. I believe we should do that | 17:00 |
| jeblair | clarkb: if --enable fixed it, then i don't think it's the default file, i think it's the lock file as nibalizer suggested | 17:00 |
| *** arnaud has quit IRC | 17:00 | |
| *** j^2 has joined #openstack-infra | 17:00 | |
| clarkb | jeblair: right, so puppet when installed is putting that lock file in place instead of setting the default value | 17:01 |
| jeblair | so, interestingly, the above error happened, but puppet agent exited sucessfully so the server stuck around | 17:01 |
| clarkb | jeblair: why? I don't know but this is the job of default files not service lock files | 17:01 |
| jeblair | clarkb: yeah, i agree with your philosophy | 17:01 |
| jeblair | clarkb: i thought you were saying that the mechanism used the default file | 17:01 |
| *** vponomaryov has quit IRC | 17:02 | |
| clarkb | gotcha | 17:02 |
| *** dhellman_ has joined #openstack-infra | 17:02 | |
| *** sarob has joined #openstack-infra | 17:03 | |
| openstackgerrit | A change was merged to openstack-infra/config: Fix transifex project names https://review.openstack.org/106427 | 17:03 |
| *** emagana has quit IRC | 17:04 | |
| *** dhellman_ has quit IRC | 17:04 | |
| *** emagana has joined #openstack-infra | 17:04 | |
| *** juzuluag has quit IRC | 17:04 | |
| jeblair | Info: /Stage[main]/Openstack_project::Base/File[/etc/apt/preferences.d/00-puppet.pref]: Filebucketed /etc/apt/preferences.d/00-puppet.pref to puppet with sum efd2443375e78391 | 17:04 |
| jeblair | 2c3b038feaadcf4e | 17:04 |
| nibalizer | jeblair: 'successfully? | 17:04 |
| *** bdpayne has quit IRC | 17:04 | |
| *** sweston_ has quit IRC | 17:04 | |
| jeblair | nibalizer: puppet agent exited with an error successfully | 17:05 |
| nibalizer | my point is that i dont see detailed-exit codes in that command you were running | 17:05 |
| nibalizer | and puppet's relaionship with exit codes is always pretty bonghits anyways | 17:05 |
| jeblair | nibalizer: are "detailed exit codes" required to indicate success or failure? :) | 17:05 |
| nibalizer | jeblair: yes, sortof | 17:05 |
| jeblair | yeah, i think it just hit that bong again. | 17:05 |
| jeblair | anyway, it gave us a server that has my ssh key on it, so we can go from there a little easier | 17:06 |
| *** juzuluag has joined #openstack-infra | 17:06 | |
| nibalizer | --detailed-exit-codes actually gives you a number which is constructed by setting different bits | 17:06 |
| nibalizer | so like it will be 4 if there are changes, 6 if there are changes and failures | 17:06 |
| jeblair | nibalizer: the current issue seems to be that it installs puppetdb-terminus after removing the apt pin file | 17:06 |
| *** _nadya_ has quit IRC | 17:06 | |
| jeblair | (assuming there is a puppetdb-terminus that is compatible with our 3.4 pin) | 17:07 |
| nibalizer | Provide transaction information via exit codes. If this is enabled, an exit code of '2' means there were changes, an exit code of '4' means there were failures during the transaction, and an exit code of '6' means there were both changes and failures. | 17:07 |
| nibalizer | yes i saw that | 17:07 |
| *** pblaho has quit IRC | 17:07 | |
| *** derekh__ has quit IRC | 17:07 | |
| nibalizer | so it removes the pin file? | 17:07 |
| nibalizer | what are you doing puppet | 17:07 |
| nibalizer | whats in 00-puppet.pref now? | 17:07 |
| *** jistr has quit IRC | 17:07 | |
| jeblair | gone | 17:07 |
| nibalizer | :sigh: | 17:08 |
| nibalizer | okay well let me go poke around infra/config and figure out what I did wrong | 17:08 |
| jeblair | 'trusty': { | 17:08 |
| jeblair | file { '/etc/apt/preferences.d/00-puppet.pref': | 17:08 |
| jeblair | ensure => absent, | 17:08 |
| nibalizer | we have code in there specifiaclly... | 17:08 |
| jeblair | modules/openstack_project/manifests/base.pp | 17:08 |
| nibalizer | oh well that was fast | 17:08 |
| jeblair | i had a head start | 17:08 |
| *** viktors has quit IRC | 17:08 | |
| nibalizer | okay ill get a change for that up in the next few minutes | 17:09 |
| jeblair | nibalizer: so maybe we should have a 00-puppet.pref for trusty in the puppet tree (like the precise one we have now) | 17:09 |
| *** emagana has quit IRC | 17:09 | |
| jeblair | nibalizer: and maybe install_puppet.sh should copy those into place for bootstrapping | 17:09 |
| jeblair | nibalizer: (so we can keep the pins in sync) | 17:09 |
| jeblair | or rather, so we don't have to keep the pins in sync | 17:10 |
| *** jedimike has quit IRC | 17:10 | |
| *** marcoemorais has quit IRC | 17:10 | |
| *** marcoemorais has joined #openstack-infra | 17:11 | |
| nibalizer | i agree | 17:11 |
| nibalizer | we can pin trusty, its good hygene | 17:11 |
| openstackgerrit | A change was merged to openstack-infra/devstack-gate: Update toggle variable for HTTPD + mod_wsgi services https://review.openstack.org/105308 | 17:11 |
| nibalizer | hyigene ? anyways you know what I maen | 17:11 |
| jeblair | nibalizer: manually putting the pin in place causes apt-get to be happy ("puppetdb-terminus is already the newest version") | 17:11 |
| nibalizer | install_puppet.sh does set up the pinning, are you talking about something else? | 17:11 |
| *** dkehnx1 has joined #openstack-infra | 17:12 | |
| clarkb | mordred: you still around? any further thoughts on mysql-connector? I actually want to push people to PyMySQL because it is also pure python and not an external package link | 17:12 |
| jeblair | nibalizer: i'm suggesting that instead of setting it with a heredoc, set it with "cp modules/openstack_project/files/00-puppet-{trusty|precise}.pref /etc/apt/preferences.d/00-puppet.pref" | 17:12 |
| *** toddmorey has joined #openstack-infra | 17:12 | |
| mordred | clarkb: mysql-connector is a non-starter until it publishes directly to pypi | 17:13 |
| openstackgerrit | Spencer Krum proposed a change to openstack-infra/config: Pin Puppet even in trusty https://review.openstack.org/106439 | 17:13 |
| mordred | hands down | 17:13 |
| clarkb | mordred: right so maybe we should jump on that thread and make sure people understand that /me does this | 17:13 |
| Alex_Gaynor | PyMySQL would be great, pypy support + MIT license | 17:13 |
| * clarkb top posts for consistency | 17:13 | |
| nibalizer | jeblair: so that file is an erb template now, not a flat file that can be copied in | 17:14 |
| *** dstanek is now known as dstanek_zzz | 17:14 | |
| nibalizer | I think that while the heredoc is duplicating logic, its okay | 17:14 |
| jeblair | when did that happen? | 17:14 |
| mordred | clarkb: I will also respond - and also will top post | 17:14 |
| clarkb | mordred: oh should I let you post then? | 17:14 |
| *** masayukig has quit IRC | 17:15 | |
| nibalizer | i would be open to the idea of firing up the erb templating engine manually and passing in puppet version | 17:15 |
| clarkb | meh we can let people sort out the race laeter | 17:15 |
| mordred | jeblair: because it has to switch on puppet 2 or 3 | 17:15 |
| nibalizer | jeblair: i did it so that we can descrimiate between puppet versions | 17:15 |
| *** bknudson has quit IRC | 17:15 | |
| mordred | clarkb: you do it - my phone is being derpy | 17:16 |
| *** chuckC has joined #openstack-infra | 17:16 | |
| jeblair | nibalizer, mordred: can we put the conditional in the puppet file? | 17:16 |
| jeblair | nibalizer, mordred: rather than the template, so they are static files again? | 17:16 |
| mordred | jeblair: what do you mean by that? | 17:16 |
| mordred | oh - you mean, have two files and grab the right one? | 17:16 |
| mordred | sure | 17:16 |
| mordred | that's a great idea | 17:17 |
| *** jgriffit1 has joined #openstack-infra | 17:17 | |
| *** jgriffit1 has quit IRC | 17:17 | |
| jeblair | yeah, because we're bootstrapping here. i don't think we have (or should count on having) a functional erb engine | 17:17 |
| *** jgriffith has quit IRC | 17:18 | |
| jeblair | nibalizer: what do you think? | 17:19 |
| *** jgriffith has joined #openstack-infra | 17:19 | |
| nibalizer | i like it the way it is | 17:19 |
| jeblair | nibalizer: the pin value is specified in two places | 17:20 |
| jeblair | nibalizer: how can we reduce that to one? | 17:20 |
| *** signed8bit is now known as signed8bit_ZZZzz | 17:20 | |
| clarkb | mordred: Alex_Gaynor sent | 17:20 |
| nibalizer | right now in the puppet code you can pass in the version of puppet you want to see happen on the box, if we move to just copying files we won't have that ability | 17:20 |
| jeblair | nibalizer: puppet is still responsible for it, we're just putting the value in a different place | 17:21 |
| jeblair | nibalizer: encoding it in the file instead of as a parameter | 17:21 |
| *** masayukig has joined #openstack-infra | 17:21 | |
| *** bdpayne has joined #openstack-infra | 17:21 | |
| jeblair | nibalizer: so it's still easy to manage existing boxes, and change their pins | 17:21 |
| * mordred agrees with jeblair | 17:22 | |
| mordred | clarkb: thank you | 17:22 |
| nibalizer | so when i want to test the 3.4 -> 3.6, i would make a new 00-puppet-3.6.perf file in the puppet files directory? | 17:22 |
| *** Ajaeger1 has joined #openstack-infra | 17:23 | |
| jeblair | nibalizer: i think when you wanted to upgrade trusty's pin from 3.4 -> 3.6, you would change the value in 00-puppet-trusty.pref from 3.4 to 3.6 | 17:23 |
| *** marun has quit IRC | 17:23 | |
| *** Ajaeger has quit IRC | 17:23 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Project Group Delete https://review.openstack.org/106441 | 17:23 |
| *** _nadya_ has joined #openstack-infra | 17:24 | |
| jeblair | mordred: in the mean time, i think we can merge this to at least correct the current situation: https://review.openstack.org/#/c/106439/ | 17:24 |
| nibalizer | jeblair: okay well we can ake that happen | 17:24 |
| nibalizer | using the files | 17:24 |
| jeblair | nibalizer: cool, you want to write that patch? | 17:25 |
| nibalizer | im happy to disagree and go forward, i'd rather pla with the puppet 3 master anyways | 17:25 |
| nibalizer | jeblair: ya no prob | 17:25 |
| *** atiwari has joined #openstack-infra | 17:25 | |
| nibalizer | jeblair: i do want to sync up with something with you real fast though | 17:25 |
| *** marun has joined #openstack-infra | 17:25 | |
| jeblair | nibalizer: i'm bummed you disagree. past experience tells us we are terrible at making sure that duplicated values are in sync. if we specify the pin in two different places, we _will_ screw it up. (actually, we just did) | 17:26 |
| *** jedimike has joined #openstack-infra | 17:26 | |
| nibalizer | it seems to me that we have slightly different ideas on the puppet-version/ubuntu-version matrix, in that i think its likely to have both precise-2.7 and precise-3 and trusty-3, it seems that you think precise-2.7 and trusty-3 are our only requirements | 17:27 |
| nibalizer | is thtat acurate | 17:27 |
| jeblair | nibalizer: no, i think we want precise-3 | 17:27 |
| jeblair | nibalizer: (so the full set of 3 values you listed) | 17:27 |
| *** signed8bit_ZZZzz is now known as signed8bit | 17:28 | |
| nibalizer | okay, cool | 17:28 |
| nibalizer | glad we're on the same page | 17:28 |
| nibalizer | and yea re ^^ i totally get the point of a single source of truth | 17:28 |
| jeblair | nibalizer: so that means the version selection is going to be a bit awkward if we do host-by-host upgrades of precise2 to precise3 | 17:28 |
| *** e0ne has quit IRC | 17:29 | |
| *** afazekas has joined #openstack-infra | 17:29 | |
| nibalizer | jeblair: why? | 17:29 |
| jeblair | nibalizer: well, i think that's what you were getting at, right? that 00-puppet-precise.pref is not sufficient | 17:29 |
| nibalizer | yes, we can't say 'hey you're precise, so do this' | 17:30 |
| nibalizer | so the install_puppet.sh now takes a version on the command line, which isn't written down | 17:30 |
| nibalizer | so 3.4 is written down in site.pp and --three is passed on the command line durring install_puppet.sh, so its really easy to get those out of sync | 17:30 |
| nibalizer | its almost like we need to write the puppet-version into site.pp and have install_module.sh read that file to determine what version of puppet to pin to | 17:31 |
| jeblair | nibalizer: launch-node.py did not give install_puppet.sh the --three argument | 17:34 |
| *** charz_ has joined #openstack-infra | 17:34 | |
| jeblair | so i think it installed 2.7, then removed the pin and upgraded itself to 3.6 | 17:34 |
| nibalizer | no on trusty you'll get a 3.x by default | 17:34 |
| *** s0nea_ has joined #openstack-infra | 17:34 | |
| nibalizer | oh wait, it what | 17:34 |
| *** jistr has joined #openstack-infra | 17:34 | |
| nibalizer | so it probably added the 2.7 pin | 17:34 |
| *** jistr is now known as jistr|off | 17:35 | |
| nibalizer | but there literally aren't 2.7 packages for trusty, i think the nodepool trusty's install from gems ya? | 17:35 |
| jeblair | oh | 17:35 |
| jeblair | nibalizer: --three is not needed for trusty | 17:35 |
| *** tcammann_ has joined #openstack-infra | 17:35 | |
| jeblair | nibalizer: it's automatic | 17:35 |
| *** plars_ has joined #openstack-infra | 17:35 | |
| nibalizer | oh good | 17:35 |
| *** mbacchi_ has joined #openstack-infra | 17:35 | |
| nibalizer | ya i see line 117 of install_puppet.sh | 17:36 |
| jeblair | nibalizer: so yeah, it probably did 3.4 then removed the pin and upgraded to 3.6 | 17:36 |
| jeblair | it might have just done that while we were talking :) | 17:36 |
| *** punal has joined #openstack-infra | 17:37 | |
| nibalizer | oaky so thats starting to make sense | 17:37 |
| *** dkliban1 has joined #openstack-infra | 17:37 | |
| *** johnthetubaguy is now known as zz_johnthetubagu | 17:37 | |
| nibalizer | so now you're on 3.6 on this new puppet master? | 17:37 |
| jeblair | yep | 17:37 |
| *** gilliard has joined #openstack-infra | 17:37 | |
| nibalizer | okay | 17:37 |
| *** mtreinish_ has joined #openstack-infra | 17:38 | |
| nibalizer | so the structure of this patch i should be making is what then? | 17:38 |
| *** spiffxp_ has joined #openstack-infra | 17:38 | |
| nibalizer | i think it is: | 17:38 |
| jeblair | nibalizer: you've convinced me not to do the file thing just yet; let's leave the levers in place until we're at least a little further along, and then see about simplifying it. | 17:38 |
| *** _shaps_ has quit IRC | 17:38 | |
| nibalizer | oh okay | 17:39 |
| *** Ajaeger has joined #openstack-infra | 17:39 | |
| *** jgriffit1 has joined #openstack-infra | 17:39 | |
| *** gmurphy_ has joined #openstack-infra | 17:39 | |
| nibalizer | so yea, can you manually downgrade puppet to 3.4 ? | 17:40 |
| *** gema_ has joined #openstack-infra | 17:40 | |
| *** sweston_ has joined #openstack-infra | 17:40 | |
| *** gyee has joined #openstack-infra | 17:40 | |
| nibalizer | the pretty soon this https://review.openstack.org/#/c/106439/ should land and you can run puppet which will re-add the .pref file | 17:40 |
| *** moted_ has joined #openstack-infra | 17:40 | |
| nibalizer | then we can start looking at puppet.conf and what-not | 17:40 |
| *** mugsie_ has joined #openstack-infra | 17:41 | |
| *** jp_at_hp has quit IRC | 17:41 | |
| *** Ajaeger1 has quit IRC | 17:41 | |
| *** jgriffith has quit IRC | 17:41 | |
| *** UtahDave has quit IRC | 17:41 | |
| *** moted has quit IRC | 17:41 | |
| *** oanufriev has quit IRC | 17:41 | |
| *** mbacchi has quit IRC | 17:41 | |
| *** morgabra has quit IRC | 17:41 | |
| *** isviridov|away has quit IRC | 17:41 | |
| *** tcammann has quit IRC | 17:41 | |
| *** mtreinish has quit IRC | 17:41 | |
| *** vladan has quit IRC | 17:41 | |
| *** gema has quit IRC | 17:41 | |
| *** gilliard_ has quit IRC | 17:41 | |
| *** plars has quit IRC | 17:41 | |
| *** kevinbenton has quit IRC | 17:41 | |
| *** mugsie has quit IRC | 17:41 | |
| *** dkliban has quit IRC | 17:41 | |
| *** spiffxp has quit IRC | 17:41 | |
| *** mfisch has quit IRC | 17:41 | |
| *** Vek has quit IRC | 17:41 | |
| *** ekarlso has quit IRC | 17:41 | |
| *** charz has quit IRC | 17:41 | |
| *** gmurphy has quit IRC | 17:41 | |
| *** s0nea has quit IRC | 17:41 | |
| *** s0nea_ is now known as s0nea | 17:41 | |
| *** isviridov has joined #openstack-infra | 17:41 | |
| *** mtreinish_ is now known as mtreinish | 17:42 | |
| *** moted_ is now known as moted | 17:42 | |
| *** zzelle has joined #openstack-infra | 17:42 | |
| *** comstud is now known as bearhands | 17:42 | |
| *** dansmith is now known as superdan | 17:42 | |
| *** mfisch has joined #openstack-infra | 17:42 | |
| *** mfisch has joined #openstack-infra | 17:42 | |
| *** _nadya_ has quit IRC | 17:42 | |
| *** russellb is now known as rustlebee | 17:42 | |
| *** vladan has joined #openstack-infra | 17:43 | |
| *** oanufriev has joined #openstack-infra | 17:44 | |
| *** markmcclain has quit IRC | 17:44 | |
| jeblair | that's exciting; the pin seemed to be ignored | 17:45 |
| *** punal has quit IRC | 17:45 | |
| *** morgabra has joined #openstack-infra | 17:45 | |
| *** jcoufal-mobile has joined #openstack-infra | 17:46 | |
| openstackgerrit | Paul Michali proposed a change to openstack/requirements: Update oslo.messaging to 1.4.0.0a3 https://review.openstack.org/103536 | 17:46 |
| nibalizer | jeblair: wow | 17:46 |
| jeblair | Package: puppet puppet-common puppetmaster puppetmaster-common puppetmaster-passenger | 17:47 |
| jeblair | Pin: version 3.4.* | 17:47 |
| nibalizer | do you think its the .* ? | 17:47 |
| jeblair | that matches what's on the precise nodes for 2.7.* | 17:47 |
| nibalizer | We debated between 3.4* and 3.4.* and I made the assumption that the later would just work | 17:47 |
| *** jcoufal-mobile has quit IRC | 17:47 | |
| nibalizer | and its working on the precise nodes? | 17:47 |
| *** jcoufal-mobile has joined #openstack-infra | 17:47 | |
| jeblair | seems to be | 17:48 |
| *** thedodd has quit IRC | 17:48 | |
| *** ekarlso has joined #openstack-infra | 17:48 | |
| *** UtahDave has joined #openstack-infra | 17:48 | |
| jeblair | 3.4* has the same result | 17:48 |
| *** arnaud has joined #openstack-infra | 17:48 | |
| Sukhdev | Folks, I have a question for the Gurus here - | 17:48 |
| *** emagana has joined #openstack-infra | 17:49 | |
| pleia2 | Sukhdev: ask away :) | 17:49 |
| *** kevinbenton has joined #openstack-infra | 17:49 | |
| pleia2 | if we can help, we will | 17:49 |
| Sukhdev | When I do ssh to receive the streaming events from Gerrit, I see the "rechech no bug" events, but, our Jenkins is not seeing them | 17:49 |
| Sukhdev | Looking for some guidance as to how to nail this down | 17:50 |
| Sukhdev | pleia2: thanks | 17:51 |
| nibalizer | jeblair: wow... i don't even know | 17:51 |
| *** e0ne has joined #openstack-infra | 17:51 | |
| *** jcoufal-mobile_ has joined #openstack-infra | 17:51 | |
| *** pballand has joined #openstack-infra | 17:51 | |
| *** reed has quit IRC | 17:52 | |
| *** jcoufal-mobile_ has quit IRC | 17:52 | |
| *** mriedem has joined #openstack-infra | 17:52 | |
| pleia2 | Sukhdev: so we use zuul to parse comments for jenkins (like all the regexes for rechecks) | 17:53 |
| *** sweston__ has joined #openstack-infra | 17:53 | |
| *** sweston_ has quit IRC | 17:53 | |
| openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: Rename requirements-integration job https://review.openstack.org/106137 | 17:54 |
| *** krtaylor has quit IRC | 17:54 | |
| pleia2 | Sukhdev: we have a config file like this for zuul to define different regexs that mean different things: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml | 17:54 |
| pleia2 | (that might help if you're looking for the regex we use for rechecks) | 17:54 |
| clarkb | note that you need to match a multiline regex with new gerrit | 17:55 |
| *** rcarrillocruz has joined #openstack-infra | 17:55 | |
| clarkb | so does this novaclient release problem mean we don't actually test master novaclient against other things? | 17:55 |
| *** jcoufal-mobile has quit IRC | 17:55 | |
| clarkb | I thought we did that? | 17:55 |
| openstackgerrit | A change was merged to openstack-infra/config: Pin Puppet even in trusty https://review.openstack.org/106439 | 17:55 |
| jeblair | clarkb: "other things"? | 17:56 |
| clarkb | jeblair: horizon in this case broke | 17:56 |
| clarkb | "this broke horizon stable and master; heat stable is affected as well." | 17:57 |
| jeblair | clarkb: should happen in devstack-gate | 17:57 |
| clarkb | right | 17:57 |
| *** jedimike has quit IRC | 17:57 | |
| clarkb | so maybe we just didn't test those code paths? | 17:57 |
| jeblair | oh, horizon _stable_ ? | 17:57 |
| clarkb | and master | 17:57 |
| jeblair | oh master sorry, missed that | 17:57 |
| *** rcarrill` has quit IRC | 17:57 | |
| clarkb | at the very least we should've caught this against master and master | 17:57 |
| jeblair | clarkb: quite possibly. horizon is nearly completely untested in the gate... | 17:57 |
| clarkb | I think the stable tests are nonvoting so probably ignored | 17:58 |
| clarkb | ya and that | 17:58 |
| jeblair | clarkb: unless it prevents horizon from starting, it's unlikely to have an effect | 17:58 |
| nibalizer | jeblair: so whats the play? | 17:59 |
| jeblair | nibalizer: i do not know why the pin is not doing what we think it should. http://paste.openstack.org/show/86139/ | 17:59 |
| *** jedimike has joined #openstack-infra | 17:59 | |
| Sukhdev | pleia2: thanks - this helps. Let me try this | 18:00 |
| nibalizer | jeblair: can you paste the pin? | 18:00 |
| nibalizer | er the .pref file? | 18:00 |
| openstackgerrit | Flavio Percoco proposed a change to openstack-infra/config: Create the glance.store repo https://review.openstack.org/106361 | 18:01 |
| jeblair | nibalizer: http://paste.openstack.org/show/86141/ | 18:01 |
| *** krtaylor has joined #openstack-infra | 18:02 | |
| jeblair | nibalizer: note also that puppetlabs doesn't supply 3.4 for trusty; that might be an issue later since our 3.4 packages will be from different sources, though i don't think it's the issue now. | 18:02 |
| nibalizer | jeblair: maybe try changint the facter one to 1*, facter 2ish maybe has a hard dependency on puppet? | 18:02 |
| openstackgerrit | Flavio Percoco proposed a change to openstack-infra/config: Create the glance.store repo https://review.openstack.org/106361 | 18:02 |
| fungi | Sukhdev: i was talking with joa about that earlier today. it seems there are some several-month-old blog posts out there with sample configuration which is outdated and doesn't work with the curent release of gerrit | 18:02 |
| jeblair | nibalizer: no change | 18:03 |
| Sukhdev | fungi: correct - one of those is blogs is mine :-) and I am trying to get it corrected | 18:04 |
| nibalizer | maybe run apt-get update? maybe the pin/selection stuff only runs then? | 18:04 |
| Sukhdev | fungi: but, having issue with capturing the correct events | 18:04 |
| jeblair | nibalizer: i think this issue can be replicated without any special access. can you take a stab at getting this working? | 18:05 |
| nibalizer | sure | 18:06 |
| jeblair | thanks | 18:08 |
| fungi | Sukhdev: right. gerrit 2.4 only sent the actual entered message content as the message text in its events, but gerrit 2.8 prepends a patchset number and vote summary header plus a blank line before the message. we discovered that when preparing to upgrade to the new gerrit, and the layout.yaml we use which pleia2 linked for you includes slightly more complex message_filter regexes to absorb that | 18:10 |
| fungi | prefix data | 18:10 |
| sarob | i have py27 failing on http://logs.openstack.org/92/94692/4/check/gate-congress-python27/f5a1be4/console.html | 18:11 |
| Sukhdev | fungi: do you know what is verdict category? | 18:13 |
| clarkb | sarob: import errors0congress.datasources.tests.unit.test_nova_driver is the relavent bit of info there | 18:13 |
| clarkb | congress.datasources.tests.unit.test_nova_driver does not import | 18:13 |
| fungi | Sukhdev: "verdict" isn't a zuul configuration parameter as far as i'm aware | 18:13 |
| *** dstanek_zzz is now known as dstanek | 18:13 | |
| Sukhdev | fungi: in reference to setting the triggers in Jenkins | 18:13 |
| fungi | Sukhdev: oh, we don't use those, so no clue | 18:14 |
| clarkb | sarob: if you want a cleaner error you can install testrepository from source | 18:14 |
| clarkb | lifeless: where are we on releasing new testrepository | 18:14 |
| *** bknudson has joined #openstack-infra | 18:15 | |
| *** dstanek is now known as dstanek_zzz | 18:15 | |
| *** SumitNaiksatam has quit IRC | 18:15 | |
| clarkb | fungi: don't forget if you do the thin fork you ened to keep track of the source too | 18:16 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Added LIKE search to project groups https://review.openstack.org/106457 | 18:16 |
| clarkb | fungi: so that you can make it available upon request :) | 18:16 |
| *** sarob has quit IRC | 18:16 | |
| *** KurtMartin has joined #openstack-infra | 18:16 | |
| *** dstanek_zzz is now known as dstanek | 18:17 | |
| fungi | clarkb: well, obviously that would be something crammed into a stackforge git repo or similar | 18:17 |
| fungi | i tried to make it sound like an ugly option, but probably could have made it sound uglier, granted | 18:17 |
| fungi | also, i have no idea what their package build process looks like, but if it's like libvirt's used to be (where the python lib was built as a byproduct of building the c lib) then ewww | 18:19 |
| *** rcarrill` has joined #openstack-infra | 18:19 | |
| clarkb | I think its pure python so probably more sane | 18:19 |
| *** rcarrillocruz has quit IRC | 18:19 | |
| fungi | ahh, well there's that at least | 18:19 |
| *** kmartin has quit IRC | 18:20 | |
| *** jedimike has quit IRC | 18:22 | |
| *** dimtruck is now known as zz_dimtruck | 18:23 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 18:25 | |
| openstackgerrit | Morgan Fainberg proposed a change to openstack-infra/config: Make POSTGRES gate job run eventlet keystone https://review.openstack.org/106460 | 18:26 |
| *** signed8bit_ZZZzz is now known as signed8bit | 18:27 | |
| *** _nadya_ has joined #openstack-infra | 18:28 | |
| *** emagana has quit IRC | 18:28 | |
| *** rcarrillocruz has joined #openstack-infra | 18:28 | |
| *** emagana has joined #openstack-infra | 18:28 | |
| *** rcarrill` has quit IRC | 18:29 | |
| *** Evgeny has joined #openstack-infra | 18:30 | |
| *** emagana has quit IRC | 18:33 | |
| *** pballand has quit IRC | 18:33 | |
| *** SumitNaiksatam has joined #openstack-infra | 18:34 | |
| * Ajaeger has three more patches for proper translation setup: fix for glance: https://review.openstack.org/#/c/106282/ ; new jobs for training-guides: https://review.openstack.org/#/c/105448/ - both need one more review that would be great to have. | 18:35 | |
| *** markmcclain has joined #openstack-infra | 18:35 | |
| Ajaeger | https://review.openstack.org/96132 will conflict with the bandersnatch series - should I note that in the patch to remind myself to update it once bandersnatch is in? | 18:36 |
| *** arnaud__ has joined #openstack-infra | 18:36 | |
| pleia2 | Ajaeger: seems reasonable | 18:36 |
| shashankhegde | fungi: With reference to gerrit plugin, I see that if I just add a comment, then I see that event does not contain any approvals | 18:36 |
| shashankhegde | Is that expected? | 18:36 |
| *** pballand has joined #openstack-infra | 18:38 | |
| *** maxbit has quit IRC | 18:38 | |
| *** jedimike has joined #openstack-infra | 18:38 | |
| clarkb | shashankhegde: yes, you have to vote for the event to contain vote information | 18:38 |
| *** arnaud has quit IRC | 18:38 | |
| shashankhegde | oh.. So if I vote '0', then I do not get any approval values? | 18:43 |
| *** zz_dimtruck is now known as dimtruck | 18:43 | |
| clarkb | shashankhegde: correct | 18:43 |
| clarkb | 0 is basically a noop vote | 18:43 |
| shashankhegde | Oh.. cool | 18:43 |
| shashankhegde | Thanks! | 18:43 |
| *** jedimike has quit IRC | 18:44 | |
| *** thedodd has joined #openstack-infra | 18:44 | |
| *** Sukhdev has quit IRC | 18:44 | |
| *** arnaud has joined #openstack-infra | 18:44 | |
| *** xianghui has joined #openstack-infra | 18:46 | |
| *** dprince has quit IRC | 18:47 | |
| *** dprince has joined #openstack-infra | 18:47 | |
| *** Mithrandir has quit IRC | 18:47 | |
| *** nati_ueno has quit IRC | 18:48 | |
| *** juzuluag has quit IRC | 18:48 | |
| *** Alexei_987 has joined #openstack-infra | 18:49 | |
| *** wenlock has quit IRC | 18:49 | |
| *** Mithrandir has joined #openstack-infra | 18:50 | |
| *** Longgeek has joined #openstack-infra | 18:52 | |
| *** reed has joined #openstack-infra | 18:54 | |
| *** adrian_otto has quit IRC | 18:55 | |
| *** salv-orlando has joined #openstack-infra | 18:55 | |
| *** otherwiseguy has quit IRC | 18:57 | |
| *** otherwiseguy has joined #openstack-infra | 18:58 | |
| pleia2 | running out for a while to do some pre-travel errands (eek, leaving tomorrow) | 19:01 |
| fungi | i need to do the same here shortly | 19:02 |
| fungi | and then pack for frankfurt+oscon | 19:02 |
| *** e0ne has quit IRC | 19:03 | |
| clarkb | same here | 19:03 |
| clarkb | well in a bit but ya | 19:03 |
| clarkb | I imagine this will be a theme today | 19:03 |
| fungi | since getting on and off the island is such a pain on the weekends at the height of tourist season, i've got a hotel room near the airport for the night between my flight in from fra and my flight out to pdx. no point in actually trying to get home and back in between | 19:04 |
| *** dimtruck is now known as zz_dimtruck | 19:04 | |
| *** e0ne has joined #openstack-infra | 19:05 | |
| *** tsg has quit IRC | 19:05 | |
| *** Longgeek has quit IRC | 19:06 | |
| fungi | also need to figure out the logistics of transport from the frankfurt airport to the maritim hotel in darmstadt for someone who speaks/reads minimal amounts of deutsche | 19:06 |
| fungi | i gather the public transit system there will suffice, as long as i can manage to navigate it | 19:06 |
| pleia2 | I think it's not too far, cab might do | 19:07 |
| Ajaeger | fungi: You speak perfect English, shouldn't be a problem ;) | 19:07 |
| Ajaeger | pleia2: cab would be rather expensive... | 19:07 |
| pleia2 | Ajaeger: ah, ok :) | 19:07 |
| * fungi only took a year of german in college... ~20 years ago | 19:07 | |
| *** amcrn has joined #openstack-infra | 19:08 | |
| clarkb | fungi: yup you take and s1, s8 or s9 from airport to frankfurt hbf | 19:09 |
| clarkb | fungi: then transfer to an s3 or s4 | 19:09 |
| *** marun has quit IRC | 19:09 | |
| *** emagana has joined #openstack-infra | 19:09 | |
| *** marun_ has joined #openstack-infra | 19:09 | |
| clarkb | navigating frankfurt hbf wasn't too bad last I aws there but I was on the platform with ICE trains | 19:09 |
| pleia2 | Ajaeger: seems like only a 20 minute drive | 19:09 |
| Ajaeger | Ah, Just checked distances - it's only 25 kms (15 miles?) and could take via the autobahn 15 mins according to Google maps. That shouldn't be too bad | 19:09 |
| fungi | clarkb: you make it sound so simple! (furiously scribbles notes) | 19:09 |
| clarkb | fungi: it really is. german public transit is amasing | 19:09 |
| pleia2 | neat | 19:10 |
| Ajaeger | pleia2: yeah ... - me lives two hours away from both towns but never went from one to the other directly ;( | 19:10 |
| pleia2 | I assume there a train station near the hotel? | 19:10 |
| clarkb | also I find that written german is easy to grok as an english speaker | 19:10 |
| marun_ | sdague: no joy on the suggested fix to the functional job :( | 19:10 |
| clarkb | much easier than french | 19:10 |
| *** andreykurilin_ has joined #openstack-infra | 19:10 | |
| clarkb | pleia2: yup its like a block away | 19:10 |
| pleia2 | cool | 19:10 |
| marun_ | sdague: still failing with the same error | 19:10 |
| fungi | clarkb: yes, english being a germanic language and all. we share basically the same sentence structure and lots of vocabulary in common | 19:10 |
| Ajaeger | The maritim is directly beside the railway station and should be a 5 min walk from both DT and railway station. | 19:11 |
| harlowja | anyway i could get a approve on https://review.openstack.org/#/c/96631/ (its been in rebase hell for a while now) | 19:11 |
| harlowja | it needs to go to repo heaven | 19:11 |
| clarkb | my flight arrives at 8:40am, I figure I might tag along with zaro to his hotel if that is where he heads | 19:11 |
| fungi | harlowja: lgtm | 19:12 |
| Ajaeger | Most Germans understand English, so no problem to speak English and ask for help. | 19:12 |
| clarkb | actually probably better to drop bag off at hotel prior to check in then go do stuff | 19:12 |
| clarkb | Ajaeger: yup and I found everyone is really helpful too | 19:12 |
| fungi | Ajaeger: good to know--thanks! | 19:12 |
| harlowja | fungi thx | 19:12 |
| fungi | clarkb: yeah, i expect to take my time between the airport and hotel, so will probably be nearly check-in by the time i find it. also not sure how to sync up if my phone ends up not working (was fine in hk, but i have no idea what de will be like) | 19:13 |
| *** mwagner_lap has joined #openstack-infra | 19:14 | |
| fungi | though i'll likely jump back on irc as soon as i can get into my room | 19:14 |
| clarkb | I will have data so can cehck irc if you manage wifi | 19:14 |
| pleia2 | yeah, I'll have data too | 19:14 |
| clarkb | and you should have my number. text messages to it will be good too | 19:14 |
| fungi | yep, perfect | 19:14 |
| Ajaeger | fungi: At the airport, there are signs to the Railway station. Keep in mind that there are two railway stations at the airport: | 19:16 |
| fungi | ooh | 19:16 |
| Ajaeger | The local trains (S-Bahn) in the "Regionalbahnhof" and the long-distance trains in the "Fernbahnhof" | 19:17 |
| fungi | okay, so i want s-bahn/regional? (s.* trains)? | 19:17 |
| Ajaeger | fungi: Yeah. | 19:18 |
| clarkb | fungi: yup. you might be able to do it with other trains but s-bahn should be cheaper and take about the same amount of time | 19:18 |
| fungi | should be easy to remember. thanks | 19:18 |
| *** shashankhegde has quit IRC | 19:18 | |
| clarkb | don't forget a german power socket adaptor :) | 19:18 |
| Ajaeger | both stations are in the same area, so the first signs might be just "Zug" or "Bahnhof" (train) - and then the s-bahn goes underground first | 19:18 |
| fungi | yeah, i have a variety of powered/active and unpowered/passive international converters, just need to grab the right ones | 19:19 |
| openstackgerrit | A change was merged to openstack-infra/config: Add templated uploading jobs for doc8 project https://review.openstack.org/96631 | 19:19 |
| Ajaeger | remember Germany has 220 Volts - not the 110. Shouldn't be a problem nowadays anymore but I blow up a system because I forgot to switch it... | 19:19 |
| clarkb | I had to pick up a usb charger for the 3ds because nintendo doesn't do wall warts with 220v support apparently | 19:19 |
| pleia2 | only my nintendo ds cares about that | 19:19 |
| clarkb | Ajaeger: ya most things support 220 now | 19:19 |
| clarkb | pleia2: jinx! | 19:19 |
| pleia2 | I have an EU charger for my DS now :) | 19:20 |
| fungi | yeah, i have an active 220->110 converter i'll bring just in case. handles up to 10a i think | 19:20 |
| pleia2 | (just need to remember to bring it!) | 19:20 |
| clarkb | pleia2: my usb charger may work if it is a dsi | 19:20 |
| Ajaeger | fungi: check first whether you really need, it - your laptop should work with both | 19:20 |
| pleia2 | it's a 3ds too | 19:20 |
| Ajaeger | fungi: did you read https://wiki.openstack.org/wiki/Qa_Infra_Meetup_2014#Frankfurt_airport_bus_transfer ? | 19:21 |
| pleia2 | Ajaeger: oh, I hadn't noticed that, thanks | 19:21 |
| clarkb | I was going to take the s-bahn anyways for fun :) | 19:22 |
| Ajaeger | fungi: That one goes every 30 mins directly to the Telekom Area - and you Hotel is at the corner of the Telekom area | 19:22 |
| fungi | oh, just double-checked. the inverter i have goes up to 500w actually | 19:22 |
| fungi | Ajaeger: oh, no i missed that | 19:22 |
| Ajaeger | The map even includes "Mina-Rees-Street" and the Maritim Hotel | 19:23 |
| clarkb | also zaro is in frankfurt proper so I was going to go into town with him on my way to darmstadt | 19:23 |
| jeblair | clarkb, fungi: i'm heading out for lunch and some errands, probably will be afk for most of the afternoon | 19:23 |
| Ajaeger | one way ticket seems to be 8.15 Euros | 19:24 |
| fungi | jeblair: noted | 19:24 |
| clarkb | jeblair: I think most of us are in the same boat | 19:24 |
| clarkb | jeblair: see you in frankfurt | 19:24 |
| jeblair | clarkb: right, the "i'm about to leave town for 2 weeks" errands :) | 19:24 |
| *** andreykurilin_ has quit IRC | 19:24 | |
| jeblair | oh, do we have a place to watch the world cup yet? | 19:25 |
| clarkb | jeblair: no but marc is aware that is a thing people want to do | 19:25 |
| *** andreykurilin_ has joined #openstack-infra | 19:25 | |
| * Ajaeger expect that any pub will do ;) | 19:25 | |
| clarkb | also that^ | 19:25 |
| fungi | i plan to end up in any pub | 19:25 |
| fungi | any pub at all | 19:25 |
| jeblair | yeah, ideally the same any pub, but yeah | 19:25 |
| fungi | ideally, yes | 19:26 |
| * jeblair hopes to remember which team to root for | 19:26 | |
| Ajaeger | There's also public viewing - Marc will know best... | 19:26 |
| clarkb | jeblair: just don't wear baby blue | 19:26 |
| clarkb | jeblair: :) | 19:26 |
| *** markmcclain has quit IRC | 19:26 | |
| Ajaeger | jeblair: very easy: You're in Germany ;) | 19:26 |
| jeblair | clarkb: excellent, thanks for the protip! | 19:26 |
| clarkb | jeblair: black is appropriate | 19:26 |
| clarkb | jeblair: so you should be set | 19:26 |
| jeblair | clarkb: yeah, that's fortuitous | 19:26 |
| fungi | clarkb: baby blue in raleigh is similarly problematic, so jeblair should be able to remember that | 19:27 |
| jeblair | fungi: yeah, for some reason it's never really figured prominently in my wardrobe | 19:27 |
| fungi | heh | 19:27 |
| fungi | i had a theory that the reason red hat settled on ncsu campus years ago was that they were properly color-coordinated | 19:28 |
| clarkb | jeblair: also red | 19:28 |
| fungi | if they had gone with blue hat, then they would have needed to pick one of the universities slightly to the west of there | 19:28 |
| *** adrian_otto has joined #openstack-infra | 19:29 | |
| openstackgerrit | Lance Bragstad proposed a change to openstack-infra/elastic-recheck: Amend e-r query for bug 1286818 https://review.openstack.org/106410 | 19:29 |
| uvirtbot | Launchpad bug 1286818 in openstack-ci "Ubuntu mirror periodically inconsistent causing gate build failures" [Low,Triaged] https://launchpad.net/bugs/1286818 | 19:29 |
| *** chandankumar has quit IRC | 19:30 | |
| *** UtahDave has quit IRC | 19:32 | |
| * Ajaeger thanks fungi for his reviews! | 19:32 | |
| fungi | Ajaeger: on 96132, what is the reason for working around the differences in django_openstack_auth as opposed to fixing them in that project? is there some additional baggage which makes it necessary? | 19:33 |
| *** homeless has quit IRC | 19:34 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add glance-upstream-translation-update https://review.openstack.org/106282 | 19:34 |
| fungi | Ajaeger: or is this the "django has its own way of dealing with translations" problem like we have with horizon? | 19:34 |
| *** adrian_otto has quit IRC | 19:34 | |
| Ajaeger | fungi: django is maintained by the horizon folks and they have their own "strange" ways indeed ;( | 19:35 |
| fungi | Ajaeger: okay, got it | 19:35 |
| fungi | i think it's not so much that they have their own strange ways of dealing with translations, as that they want to be able to make use of the translation support in django and do translations the way lots of django projects do, which makes some sense to me | 19:36 |
| Ajaeger | fungi: 96132 will need some trivial changes for bandersnatch (or the other way round - whatever merges first) | 19:36 |
| Ajaeger | fungi, you have a nice way of saying it - yeah, that seems to be the reason, it seems to be following django and not python ways | 19:37 |
| fungi | Ajaeger: that's fine. if 96132 lands first, an inline comment on the conflicting cleanup change would be appreciated at that point. i already expect to need to do at least one more rebase on those and catch them up to the current state of jobs/scripts once they have enough reviews | 19:37 |
| *** bknudson has quit IRC | 19:37 | |
| Ajaeger | fungi: will remember to do it - just commented on 96132 only... | 19:38 |
| * Ajaeger doesn't mind if this one finally merges ;) | 19:38 | |
| *** bknudson has joined #openstack-infra | 19:38 | |
| *** arnaud__ has quit IRC | 19:38 | |
| *** arnaud has quit IRC | 19:38 | |
| openstackgerrit | A change was merged to openstack-infra/config: Setup training-guides for translation https://review.openstack.org/105448 | 19:38 |
| *** tsg has joined #openstack-infra | 19:39 | |
| *** weshay has quit IRC | 19:40 | |
| *** tusharsg has joined #openstack-infra | 19:41 | |
| fungi | Ajaeger: 96132 looks fine to me | 19:41 |
| *** homeless has joined #openstack-infra | 19:41 | |
| * fungi disappears to do not-here things | 19:41 | |
| Ajaeger | fungi: thanks. | 19:42 |
| * Ajaeger now only needs another +2 for 96132 and then translations should be in great shape for the moment;) | 19:43 | |
| *** tsg has quit IRC | 19:43 | |
| *** andreykurilin_ has quit IRC | 19:44 | |
| *** dprince has quit IRC | 19:44 | |
| * clarkb looks | 19:45 | |
| *** andreykurilin_ has joined #openstack-infra | 19:45 | |
| *** bknudson has quit IRC | 19:45 | |
| *** tusharsg has quit IRC | 19:45 | |
| Ajaeger | thanks, clarkb ! | 19:47 |
| *** kevinbenton has quit IRC | 19:48 | |
| *** kevinbenton has joined #openstack-infra | 19:49 | |
| *** e0ne has quit IRC | 19:49 | |
| *** bknudson has joined #openstack-infra | 19:49 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Added LIKE search to project groups https://review.openstack.org/106457 | 19:50 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Added LIKE search to project groups https://review.openstack.org/106457 | 19:51 |
| *** banix has quit IRC | 19:51 | |
| openstackgerrit | A change was merged to openstack-infra/config: Fix django_openstack_auth translation setup https://review.openstack.org/96132 | 19:52 |
| *** Vek has joined #openstack-infra | 19:52 | |
| *** bknudson has quit IRC | 19:53 | |
| *** _nadya_ has quit IRC | 19:56 | |
| *** prad has quit IRC | 19:56 | |
| *** changbl has quit IRC | 19:56 | |
| *** _nadya_ has joined #openstack-infra | 19:57 | |
| *** hasharVacations has joined #openstack-infra | 19:59 | |
| *** hasharVacations has quit IRC | 19:59 | |
| *** hashar has joined #openstack-infra | 19:59 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Document use of bandersnatch for pypi mirroring https://review.openstack.org/106431 | 19:59 |
| clarkb | and with that it is now my turn to go find lunch and pack and all that | 20:00 |
| *** hashar is now known as hasharVacations | 20:00 | |
| *** mkoderer has quit IRC | 20:02 | |
| openstackgerrit | Andreas Jaeger proposed a change to openstack-infra/config: Create the glance.store repo https://review.openstack.org/106361 | 20:03 |
| *** homeless has quit IRC | 20:04 | |
| *** _nadya_ has quit IRC | 20:04 | |
| *** marcoemorais has quit IRC | 20:06 | |
| *** marcoemorais has joined #openstack-infra | 20:07 | |
| *** marcoemorais has joined #openstack-infra | 20:07 | |
| *** pballand has quit IRC | 20:07 | |
| *** amcrn has quit IRC | 20:08 | |
| *** __afazekas has quit IRC | 20:09 | |
| *** changbl has joined #openstack-infra | 20:12 | |
| *** mestery has quit IRC | 20:12 | |
| mordred | dammit. most likely nobody in the channel cares about this next thing ... | 20:12 |
| mordred | clarkb: dude, lebron is going back to the cavs!!! | 20:12 |
| *** eharney has quit IRC | 20:13 | |
| clarkb | :) | 20:13 |
| *** marcoemorais has quit IRC | 20:13 | |
| clarkb | yes and espn failed | 20:13 |
| clarkb | it was glorious | 20:13 |
| *** marcoemorais has joined #openstack-infra | 20:13 | |
| *** Krinkle has joined #openstack-infra | 20:14 | |
| openstackgerrit | Mark McLoughlin proposed a change to openstack/requirements: Update oslo.config to 1.4.0.0a1 https://review.openstack.org/103256 | 20:14 |
| Krinkle | I'm having issues building jenkins-job-builder on macosx. Any known issues? https://gist.github.com/Krinkle/db81425dc783bfa9e0f0 | 20:14 |
| *** fifieldt has quit IRC | 20:15 | |
| clarkb | zaro ^ | 20:15 |
| openstackgerrit | Mark McLoughlin proposed a change to openstack/requirements: Update oslo.config to 1.4.0.0a2 https://review.openstack.org/103256 | 20:15 |
| *** zz_dimtruck is now known as dimtruck | 20:16 | |
| *** weshay has joined #openstack-infra | 20:16 | |
| clarkb | Krinkle does `pip install -e .` work? | 20:16 |
| *** masayukig has quit IRC | 20:16 | |
| mordred | clarkb: also, kevin love may join them | 20:16 |
| clarkb | also you may need to upgrade setuptools | 20:17 |
| *** Hal has joined #openstack-infra | 20:17 | |
| bodepd | if I omit success/start/failure from my pipeline, does it mean that I can consume events from gerrits without posting back results? | 20:17 |
| *** Hal is now known as Guest58599 | 20:17 | |
| Krinkle | clarkb: indeed it does! | 20:17 |
| clarkb | bodepd: yes | 20:17 |
| Krinkle | clarkb: Requirement already up-to-date: setuptools in /usr/local/lib/python2.7/site-packages | 20:18 |
| anteaya | so some additional neutron devs know more about gerrit, infra and elastic-recheck | 20:18 |
| hasharVacations | we had users reporting the same issue with git-review :/ | 20:18 |
| Krinkle | Could use a newer python I guess, or is that not yet recommended for jjb? | 20:18 |
| *** arnaud__ has joined #openstack-infra | 20:19 | |
| anteaya | also I hope the first draft of a wip infra-spec for multinode testing will be posted soon | 20:19 |
| anteaya | it is in progress | 20:19 |
| *** arnaud has joined #openstack-infra | 20:19 | |
| clarkb | Krinkle 2.7 is good | 20:20 |
| Krinkle | clarkb: so, should I change documentation for building jjb? | 20:20 |
| Krinkle | Im curious why it didn't wokr | 20:20 |
| Krinkle | work* | 20:20 |
| *** mbacchi_ has quit IRC | 20:21 | |
| *** masayukig has joined #openstack-infra | 20:21 | |
| Krinkle | clarkb: I ran the old command again and it seems to kind of work this now (after the one you gave me) | 20:21 |
| Krinkle | though with loads of warnings | 20:21 |
| Krinkle | https://gist.github.com/Krinkle/db81425dc783bfa9e0f0#file-jjb-2 | 20:22 |
| clarkb | ya we should suggest pip | 20:22 |
| nibalizer | so uh is paste down? | 20:22 |
| clarkb | I think pbr may be to blame | 20:22 |
| clarkb | nibalizer jjst derpy | 20:22 |
| *** emagana has quit IRC | 20:22 | |
| clarkb | it disconnects from the db | 20:22 |
| mordred | clarkb: we really need to figure out what's up with that I think | 20:22 |
| mordred | and/or fix it | 20:22 |
| mordred | and/or just do something different | 20:23 |
| *** atiwari has quit IRC | 20:23 | |
| mordred | and/or do nothing | 20:23 |
| clarkb | ++ | 20:23 |
| ryanpetrello | anybody around that can lend me some jjb/zuul assistance? | 20:23 |
| Krinkle | clarkb: What would be the --user equiv of that? | 20:23 |
| *** Guest58599 has quit IRC | 20:23 | |
| *** miqui has quit IRC | 20:24 | |
| ryanpetrello | I have a few custom tox jobs I’m running, http://logs.openstack.org/01/106401/1/check/gate-pecan-python26/ and http://logs.openstack.org/01/106401/1/check/gate-pecan-python33/ | 20:24 |
| *** shashankhegde has joined #openstack-infra | 20:24 | |
| ryanpetrello | but they’re failing because they’re using py27 | 20:24 |
| clarkb | Krinkle: --user? | 20:25 |
| *** crinkle has joined #openstack-infra | 20:25 | |
| nibalizer | jeblair: figured out the puppet pinning problem | 20:25 |
| clarkb | sorry eating lunch and failing at braining | 20:25 |
| Krinkle | clarkb: python setup.py develop --user | 20:25 |
| Krinkle | (which installs it locally instead of globally) | 20:26 |
| *** blkperl has joined #openstack-infra | 20:26 | |
| Krinkle | I don't particularly care, but our documetnation mentions both, | 20:26 |
| Krinkle | https://www.mediawiki.org/wiki/Continuous_integration/Jenkins_job_builder#Install_JJB | 20:26 |
| mordred | Krinkle: pip install -e --user . | 20:26 |
| clarkb | oh. do a pip install -e in a vrtualenv | 20:26 |
| Krinkle | ideally they'd both use the same kind of installer | 20:26 |
| clarkb | or that | 20:26 |
| *** nightfly has joined #openstack-infra | 20:26 | |
| AaronGr | nibalizer: what was it? | 20:26 |
| nibalizer | whitespace | 20:27 |
| Krinkle | Thanks :) | 20:27 |
| AaronGr | doh. | 20:27 |
| *** IAX has quit IRC | 20:27 | |
| jesusaurus | nibalizer: really? | 20:27 |
| ryanpetrello | actually, correct what I said above: the issue is that the jobs are getting run on a node that don’t seem to have the version of Python I want | 20:28 |
| ryanpetrello | e.g., “ERROR: InterpreterNotFound: python3.3” | 20:28 |
| clarkb | Krinkle pip is the installer | 20:28 |
| Krinkle | clarkb: Yes, I get that :) I didn't know it had a --user flag. sorry. | 20:28 |
| *** fifieldt has joined #openstack-infra | 20:28 | |
| *** homeless has joined #openstack-infra | 20:29 | |
| *** Ajaeger has quit IRC | 20:30 | |
| *** marcoemorais has quit IRC | 20:30 | |
| *** emagana has joined #openstack-infra | 20:30 | |
| *** gondoi is now known as zz_gondoi | 20:30 | |
| * mordred throws a --user flag at clarkb | 20:32 | |
| *** elambert has quit IRC | 20:32 | |
| *** atiwari has joined #openstack-infra | 20:33 | |
| reed | now is newsletter time | 20:35 |
| *** Guest58599 has joined #openstack-infra | 20:36 | |
| nibalizer | jesusaurus: ya extra whitesace at the end of some of the lines in my 00-puppet.pref was breaking it | 20:36 |
| nibalizer | on removal, everything is poinies and butterflies | 20:36 |
| nibalizer | also rainbows | 20:36 |
| jesusaurus | nibalizer: awesome | 20:36 |
| *** pballand has joined #openstack-infra | 20:38 | |
| *** rfolco has quit IRC | 20:38 | |
| *** pdmars has quit IRC | 20:38 | |
| *** Guest58599 has quit IRC | 20:46 | |
| Krinkle | Thanks again clarkb, mordred, | 20:46 |
| *** Krinkle has left #openstack-infra | 20:46 | |
| *** marun_ has quit IRC | 20:47 | |
| *** adrian_otto has joined #openstack-infra | 20:48 | |
| *** jogo is now known as flashgordon | 20:50 | |
| *** mriedem has quit IRC | 20:51 | |
| *** markmcclain has joined #openstack-infra | 20:52 | |
| *** markmcclain1 has joined #openstack-infra | 20:53 | |
| *** datsun181b has joined #openstack-infra | 20:54 | |
| *** datsun180b has quit IRC | 20:54 | |
| *** datsun181b has quit IRC | 20:55 | |
| *** elambert has joined #openstack-infra | 20:56 | |
| *** datsun180b has joined #openstack-infra | 20:56 | |
| *** markmcclain has quit IRC | 20:56 | |
| *** adrian_otto has quit IRC | 20:59 | |
| *** adrian_otto has joined #openstack-infra | 21:02 | |
| openstackgerrit | Edgar Magana proposed a change to openstack-infra/infra-specs: WIP - Multinode spec for Neutron DVR testing https://review.openstack.org/106495 | 21:04 |
| anteaya | yay!! | 21:05 |
| openstackgerrit | Alexei Kornienko proposed a change to openstack/requirements: Unbind version of pyzmq https://review.openstack.org/106497 | 21:05 |
| *** HACKING-TWITTER] has joined #openstack-infra | 21:06 | |
| *** SumitNaiksatam has quit IRC | 21:06 | |
| *** marcoemorais has joined #openstack-infra | 21:07 | |
| openstackgerrit | Edgar Magana proposed a change to openstack-infra/infra-specs: WIP - Multinode spec for Neutron DVR testing https://review.openstack.org/106495 | 21:08 |
| *** eharney has joined #openstack-infra | 21:10 | |
| *** prad has joined #openstack-infra | 21:11 | |
| anteaya | dhellmann: oslosphix is doing interesting things with an asciiflow diagram: http://docs-draft.openstack.org/95/106495/2/check/gate-infra-specs-docs/245a065/doc/build/html/specs/multinode-testing.html#proposed-change | 21:11 |
| bodepd | I've also been seeing some weirdness with pip stuff and jjb: https://gist.github.com/bodepd/b10a76cef3adb6581c62 | 21:12 |
| anteaya | dhellmann: any suggested options for making the diagram (which works for the raw .rst file) work in the published docs? | 21:12 |
| krotscheck | So, anyone out there having a lovely afternoon that they’d just LOVE to ruin by doing a 1000 line javascript review? https://review.openstack.org/#/c/99975 | 21:15 |
| krotscheck | (Do be fair, it’s about 50% html, too :) ) | 21:16 |
| ryanpetrello | clarkb: any idea if https://github.com/stackforge/python-jenkins/commit/aa16b89bdfcce38b610c60fce0302ac506835967 is going to be released to pypi sometime soon? | 21:19 |
| ryanpetrello | 0.3.1 is currently…broken :) | 21:19 |
| clarkb | ryanpetrello: zaro was working on it, I would expect him to push the fix but I am not sure | 21:20 |
| clarkb | krotscheck: we are all getting ready for frankfurt | 21:20 |
| *** whoops has joined #openstack-infra | 21:20 | |
| ryanpetrello | ^ zaro | 21:21 |
| krotscheck | clarkb: So what you’re saying is that you’ll all have time on the transatlantic flights to review it? :D | 21:21 |
| ryanpetrello | heh | 21:21 |
| clarkb | krotscheck: uh maybe? I should actually make sure gertty syncs now | 21:21 |
| * clarkb starts gertty | 21:22 | |
| *** doddstack has joined #openstack-infra | 21:22 | |
| *** derekh__ has joined #openstack-infra | 21:23 | |
| *** thedodd has quit IRC | 21:24 | |
| *** otherwiseguy has quit IRC | 21:25 | |
| *** dims_ has joined #openstack-infra | 21:28 | |
| *** dkranz has joined #openstack-infra | 21:28 | |
| *** pelix has quit IRC | 21:28 | |
| *** mfer has quit IRC | 21:29 | |
| *** dims_ has quit IRC | 21:29 | |
| *** dims_ has joined #openstack-infra | 21:30 | |
| *** dimsum has quit IRC | 21:30 | |
| clarkb | krotscheck: I will review https://review.openstack.org/#/c/106152/ because its easy :) | 21:31 |
| clarkb | krotscheck: let me know if yo uhave questions about what is needed but if you look at the top of the jobs list in zuuls layout.yaml it should be clear | 21:31 |
| *** rcarrillocruz has quit IRC | 21:32 | |
| *** dkranz has quit IRC | 21:32 | |
| *** rcarrillocruz has joined #openstack-infra | 21:33 | |
| *** otherwiseguy has joined #openstack-infra | 21:33 | |
| *** Sukhdev has joined #openstack-infra | 21:34 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/config: Added NodeJS and NPM to javascript build https://review.openstack.org/106152 | 21:35 |
| krotscheck | clarkb: Like that? ^^ | 21:35 |
| *** sarob has joined #openstack-infra | 21:35 | |
| *** emagana has quit IRC | 21:35 | |
| clarkb | krotscheck: yup | 21:36 |
| *** changbl has quit IRC | 21:40 | |
| *** Sukhdev has quit IRC | 21:41 | |
| *** jistr|off has quit IRC | 21:42 | |
| *** amcrn has joined #openstack-infra | 21:44 | |
| *** derekh__ has quit IRC | 21:44 | |
| *** rkukura has quit IRC | 21:45 | |
| *** signed8bit has quit IRC | 21:45 | |
| *** emagana has joined #openstack-infra | 21:47 | |
| openstackgerrit | A change was merged to openstack/requirements: Add libvirt-python for nova. https://review.openstack.org/105500 | 21:48 |
| *** SumitNaiksatam has joined #openstack-infra | 21:48 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Added LIKE search to project groups https://review.openstack.org/106457 | 21:51 |
| *** otherwiseguy has quit IRC | 21:51 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Project Group member DELETE method returns 204 https://review.openstack.org/106507 | 21:51 |
| bodepd | I figured out how to work around that jjb issue. | 21:52 |
| bodepd | I just need to easy_install pbr adn ignore the fact that it fails | 21:52 |
| bodepd | and then jjb works | 21:52 |
| *** maxbit has joined #openstack-infra | 21:53 | |
| *** marun has joined #openstack-infra | 21:53 | |
| *** marcoemorais has quit IRC | 21:56 | |
| *** marcoemorais1 has joined #openstack-infra | 21:56 | |
| *** dstanek is now known as dstanek_zzz | 21:56 | |
| mordred | bodepd: why would you want to easy_install pbr? | 21:58 |
| *** praneshp has quit IRC | 22:00 | |
| *** Sukhdev has joined #openstack-infra | 22:01 | |
| bodepd | b/c otherwise jjb fails | 22:01 |
| dstufft | mordred: s/pbr/anything/ | 22:01 |
| mordred | dstufft: exactly | 22:01 |
| bodepd | I posted the stack trace before. I just randomly tried stuff until I could get jjb to work | 22:02 |
| bodepd | easy_install pbr happend to be the thing | 22:02 |
| bodepd | (despite the fact that the command failed_ | 22:02 |
| *** markmcclain1 has quit IRC | 22:02 | |
| bodepd | ) | 22:02 |
| clarkb | bodepd: is this the same fail that krinkle ran into? | 22:02 |
| clarkb | bodepd: it was fixed by pip installing | 22:02 |
| dstufft | I'd be $5 that easy_install uninstalled something and then failed | 22:02 |
| bodepd | pbr is already installed correclry via pip | 22:02 |
| dstufft | and the uninstalling unwedged it | 22:02 |
| mordred | yeah. easy_install should always be avoided | 22:02 |
| *** shashankhegde has quit IRC | 22:03 | |
| dstufft | bet* | 22:03 |
| mordred | it's the devil | 22:03 |
| dstufft | mordred: lol setup_requires QQ | 22:03 |
| * mordred stabs | 22:03 | |
| *** rcarrill` has joined #openstack-infra | 22:03 | |
| mordred | dstufft: when are you going to fix that and simplify my life? | 22:03 |
| *** hasharVacations has quit IRC | 22:03 | |
| dstufft | mordred: idk, so much to do ;( | 22:03 |
| bodepd | mordred: https://gist.github.com/bodepd/9799622b5cc6159de62e | 22:03 |
| bodepd | that is the failure, and it fails despite the fact that pbr was installed by pip as the right version | 22:04 |
| mordred | oh. weird | 22:04 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Project group item PUT method now returns project https://review.openstack.org/106510 | 22:04 |
| bodepd | and installing via easy_install allows that command to work | 22:04 |
| dstufft | what version of pip | 22:04 |
| dstufft | oh jjb uses entrypoints | 22:05 |
| bodepd | I think latest | 22:05 |
| dstufft | ok I up my bet to $10 that easy_install uninstalled something which unwedged it | 22:05 |
| *** rcarrillocruz has quit IRC | 22:05 | |
| bodepd | it just stated happending two days ago | 22:05 |
| dstufft | er not uninstalled, but overwrote | 22:05 |
| bodepd | without chnages, I use the same install latest pip method infra uses | 22:05 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Admin Project Group UI https://review.openstack.org/105287 | 22:06 |
| dstufft | can you repro it | 22:06 |
| bodepd | yeah. it'll take me 10 or so minutes | 22:06 |
| bodepd | I blew away that machine, b/c I was going to test a from scratch build with the easy_install of pbr | 22:06 |
| *** marcoemorais1 has quit IRC | 22:07 | |
| dstufft | it'd be interesting to see the results of ``pip list`` and ``python -c "import sys; print(sys.path)"`` | 22:07 |
| *** andreaf has joined #openstack-infra | 22:09 | |
| *** morganfainberg is now known as morganfainberg_Z | 22:10 | |
| *** dimtruck is now known as zz_dimtruck | 22:11 | |
| *** zz_dimtruck is now known as dimtruck | 22:11 | |
| *** marcoemorais has joined #openstack-infra | 22:11 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Project group item PUT method now returns project https://review.openstack.org/106510 | 22:12 |
| reed | krtaylor, newsletter out, with Third Party blurb | 22:12 |
| *** shashankhegde has joined #openstack-infra | 22:12 | |
| *** aysyd has quit IRC | 22:14 | |
| *** andreaf has quit IRC | 22:14 | |
| *** obondarev has quit IRC | 22:15 | |
| *** weshay has quit IRC | 22:18 | |
| *** hogepodge has quit IRC | 22:18 | |
| *** elambert has quit IRC | 22:19 | |
| *** dimtruck is now known as zz_dimtruck | 22:21 | |
| *** ArxCruz has quit IRC | 22:21 | |
| bodepd | dstufft: https://gist.github.com/bodepd/2162435b38fa937671d6 | 22:21 |
| *** mfink_ has quit IRC | 22:21 | |
| dstufft | bodepd: can you do ls -l /usr/local/lib/python2.7/dist-packages | 22:22 |
| *** carl_baldwin has quit IRC | 22:22 | |
| bodepd | pbr is in there :) | 22:22 |
| *** sabeen1 has quit IRC | 22:22 | |
| *** marcoemorais has quit IRC | 22:22 | |
| *** marcoemorais has joined #openstack-infra | 22:23 | |
| bodepd | dstufft: https://gist.github.com/bodepd/8cc14533295452b13afa | 22:23 |
| dstufft | hmm | 22:23 |
| *** elambert has joined #openstack-infra | 22:24 | |
| dstufft | bodepd: what about ls -l /usr/lib/python2.7/dist-packages | 22:24 |
| dstufft | oh! | 22:24 |
| dstufft | wait | 22:24 |
| dstufft | I know the problem | 22:24 |
| dstufft | You have distribute (0.6.24dev-r0) | 22:24 |
| *** emagana has quit IRC | 22:24 | |
| dstufft | You *need* setuptools >= 6.11.28 (IIRC) in order for pkg_resources entrypoints to be able to find things installed from a Wheel (things with a .dist-info directory) | 22:25 |
| dstufft | er | 22:25 |
| dstufft | 0.6.28 | 22:25 |
| dstufft | not sure where the 11 came from | 22:25 |
| bodepd | distribute-0.6.24dev_r0.egg-info | 22:25 |
| dstufft | I think it was 0.6.28, | 22:25 |
| dstufft | yes, that's too old | 22:25 |
| dstufft | it won't recognize the dist-info directory | 22:26 |
| *** pballand has quit IRC | 22:26 | |
| dstufft | you need to either a) upgrade your setuptools or b) use pip with pip --no-use-wheel | 22:26 |
| dstufft | the reason easy_install works is becuase it's dropping an egg-info instead of a dist-info | 22:26 |
| *** andreykurilin_ has quit IRC | 22:27 | |
| *** markmc has quit IRC | 22:29 | |
| *** pballand has joined #openstack-infra | 22:29 | |
| *** mfink has joined #openstack-infra | 22:29 | |
| *** ZZelle_ has quit IRC | 22:33 | |
| *** ZZelle_ has joined #openstack-infra | 22:33 | |
| *** datsun180b has quit IRC | 22:35 | |
| bodepd | dstufft: thanks. It looks like upgrading setuptools works | 22:36 |
| *** otherwiseguy has joined #openstack-infra | 22:38 | |
| *** beagles has quit IRC | 22:39 | |
| *** marcoemorais has quit IRC | 22:40 | |
| *** marcoemorais has joined #openstack-infra | 22:40 | |
| *** praneshp has joined #openstack-infra | 22:41 | |
| fungi | yeah, we've got the same bug open against git-review since both it and jjb just released their first versions with pbr-based packaging | 22:42 |
| fungi | bug 1337701 | 22:43 |
| uvirtbot | Launchpad bug 1337701 in git-review "git review 1.24 fails on OS X 10.9.2 with pkg_resources.DistributionNotFound: git-review" [Medium,Triaged] https://launchpad.net/bugs/1337701 | 22:43 |
| *** praneshp_ has joined #openstack-infra | 22:44 | |
| *** prad has quit IRC | 22:45 | |
| *** praneshp has quit IRC | 22:46 | |
| *** praneshp_ is now known as praneshp | 22:46 | |
| *** emagana has joined #openstack-infra | 22:47 | |
| *** marun has quit IRC | 22:48 | |
| *** Ryan_Lane has quit IRC | 22:51 | |
| *** marcoemorais has quit IRC | 22:53 | |
| *** marun has joined #openstack-infra | 22:54 | |
| *** atiwari has quit IRC | 22:54 | |
| *** Ryan_Lane has joined #openstack-infra | 22:54 | |
| jhesketh | Morning | 22:55 |
| *** arnaud has quit IRC | 22:55 | |
| *** arnaud__ has quit IRC | 22:55 | |
| *** rkukura has joined #openstack-infra | 22:57 | |
| clarkb | o/ | 22:58 |
| *** david-lyle has quit IRC | 22:59 | |
| *** whoops has quit IRC | 23:00 | |
| *** arnaud has joined #openstack-infra | 23:01 | |
| *** arnaud__ has joined #openstack-infra | 23:01 | |
| *** reed has quit IRC | 23:02 | |
| *** marun has quit IRC | 23:05 | |
| zaro | ryanpetrello, clarkb : waiting for these to be approved before making python-jenkins release to pypi. https://review.openstack.org/#/c/106119/ AND https://review.openstack.org/#/c/106121/ | 23:05 |
| zaro | clarkb: we should totally hang out after arrival, lets find some good bear and watch world cup finals. | 23:07 |
| clarkb | zaro: yes world cup watching is going to happen | 23:10 |
| clarkb | but game is at 9pm so we haev lots of time | 23:10 |
| *** zz_dimtruck is now known as dimtruck | 23:10 | |
| *** sabeen1 has joined #openstack-infra | 23:10 | |
| zaro | ohh, i thought it was in the AM. well your welcome to stay at my hotel as long as you like. | 23:12 |
| *** armax has quit IRC | 23:12 | |
| *** pballand has quit IRC | 23:13 | |
| *** masayukig has quit IRC | 23:13 | |
| clarkb | zaro: this is the proble with flying east, everything is so late | 23:14 |
| clarkb | zaro: you ready for the 9 hour time difference? | 23:15 |
| clarkb | zaro: also lebron to cleveland | 23:16 |
| *** gyee has quit IRC | 23:16 | |
| *** doddstack has quit IRC | 23:18 | |
| *** pcm_ has quit IRC | 23:18 | |
| *** dimtruck is now known as zz_dimtruck | 23:19 | |
| *** HenryG has quit IRC | 23:22 | |
| *** markwash has quit IRC | 23:22 | |
| *** otherwiseguy has quit IRC | 23:26 | |
| *** otherwiseguy has joined #openstack-infra | 23:27 | |
| *** pcm_ has joined #openstack-infra | 23:29 | |
| *** Sukhdev has quit IRC | 23:31 | |
| *** zzelle has quit IRC | 23:31 | |
| zaro | clarkb: ready or not, it's coming. | 23:34 |
| zaro | clarkb: totally didn't expect that to happen. but makes league more interesting so +1 | 23:34 |
| *** emagana has quit IRC | 23:38 | |
| zaro | clarkb: i've just realized that gerrit project approves changes either very quickly or very slowly. makes me appreciate the openstack approval policy. | 23:39 |
| *** pcm_ has quit IRC | 23:40 | |
| *** IAX has joined #openstack-infra | 23:50 | |
| *** IAX has quit IRC | 23:50 | |
| *** emagana has joined #openstack-infra | 23:51 | |
| openstackgerrit | Spencer Krum proposed a change to openstack-infra/config: First draft of enabling beaker tests to run https://review.openstack.org/102071 | 23:52 |
| *** arnaud has quit IRC | 23:52 | |
| *** arnaud__ has quit IRC | 23:52 | |
| *** elambert has quit IRC | 23:53 | |
| *** dkehnx1 has quit IRC | 23:53 | |
| *** rfolco has joined #openstack-infra | 23:55 | |
| nibalizer | anteaya: want to peek at https://review.openstack.org/#/c/102071/ | 23:55 |
| nibalizer | when you get a chance | 23:55 |
| *** rfolco has quit IRC | 23:56 | |
| *** toddmorey has quit IRC | 23:57 | |
| *** adrian_otto has quit IRC | 23:58 | |
| *** adrian_otto has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!