Thursday, 2014-07-31

openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Zuul depends indirectly on lxml  https://review.openstack.org/11080700:00
fungicomment added, and commit message fixed ^00:00
arosennodepool downloads so much to the guest i hope i have enough disk space :)00:00
arosen36% full, only have a 16 gig disk for my image. Hopefully that's big enough.00:00
fungiarosen: for our systems we manage to get by with instances which have only a 10gb root partition (but we jump through a lot of hoops to link workspace activity into an ephemeral disk on the instances in that situation)00:00
notmynameI keep getting bugged about updating git-review. but pip tells me I'm already up to date00:01
notmynameis there a known issue that I'm doing something wrong?00:01
funginotmyname: what's pip --version say?00:01
*** elambert has quit IRC00:02
fungier, git review --version i mean00:02
openstackgerritA change was merged to openstack-infra/config: Remove hpcloud-region-b  https://review.openstack.org/10792200:02
fungii suspect you really are running an older version, because we removed that nag entirely in the most recent release00:02
arosenfungi:  at the uploading to glance stage :)00:02
*** garyh has quit IRC00:03
notmynamefungi: 1.23. (side note, that command only works if I'm in a git repo, not elsewhere)00:03
funginotmyname: also a bug which got fixed in 1.24 ;)00:03
notmynamefungi: https://gist.github.com/notmyname/a2640b17c88bdc1035d800:04
funginotmyname: does pip freeze or pip list mention an old version?00:04
notmynamefungi: pip list says 1.2400:04
fungihuh... try 'which git-review' and see if you have an old entrypoint linked in your path somewhere weird?00:05
*** MarkAtwood has quit IRC00:05
*** ZZelle_ has quit IRC00:05
notmynameuninstall + install, and now pkg_resources.DistributionNotFound: git-review00:06
fungithat's due to pbr not working with an old setuptools (0.7 or later is needed i think)00:07
notmynameupdating setuptools worked00:07
notmynamethanks00:07
fungiyw!00:07
openstackgerritA change was merged to openstack-infra/config: Update ci.openstack.org footer  https://review.openstack.org/10765600:07
fungiand now you should (hopefully!) be able to git review --version outside a git repo too ;)00:08
notmynamefungi: so it seems that the upgrade got half-installed when setuptools wasn't install00:08
notmynameed00:08
notmynameright00:08
notmynamemaybe a newer setuptools should be int he dependencies of git-review (jsut guessing)00:08
*** yjiang5 has joined #openstack-infra00:09
fungisetuptools doesn't really work as a declared dependency for $reasons00:09
fungimostly a chicken-and-egg problem00:09
fungiand a seed for hours of ranting on why python packaging why00:09
*** samy has joined #openstack-infra00:10
*** samy is now known as Guest1507000:11
fungithe underlying issue being that setuptools is already imported and runnign by the time you're trying to install a package which declares a dependency on a newer setuptools and then *fail*00:11
fungiarosen: my anecdote about 10gb root filesystems is no longer valid... looks like these days we get 30gb on the provider i was thinking of. but the good news is that we only seem to use about 4gb of it in devstack node images and 9gb in "bare" node images (and no the irony on the naming of the bare nodes is not lost on us)00:15
fungier, typo on the devstack images... it's more like 5gb there00:16
*** mfer has joined #openstack-infra00:17
openstackgerritA change was merged to openstack-infra/config: Add experimental Centos7 job  https://review.openstack.org/11017800:18
arosenfungi:00:18
arosen| ID | Provider | Image | Hostname                                | Version    | Image ID                             | Server ID                            | State | Age (hours) |00:18
arosen+----+----------+-------+-----------------------------------------+------------+--------------------------------------+--------------------------------------+-------+-------------+00:18
arosen| 45 | local_01 | d-p-c | d-p-c-1406762544.template.openstack.org | 1406762544 | f1c6c71f-4dd5-4456-9b06-da0834329a70 | 0922883f-2126-4043-99dd-2da09486321d | ready | 0.06        |00:18
arosensuccess :)00:18
fungiarosen: looks like beer-thirty to me00:18
aroseni see it launching my snapshotted images now00:18
arosenYup soon :)00:18
fungioh, right, don't celebrate until the nodes themselves are ready and reachable ;)00:19
arosenhaha yea. In spawning state. We only have 1gig interfaces on our servers00:19
jheskethfungi: Did you put the comment on the wrong line here: https://review.openstack.org/#/c/110807/3/modules/zuul/manifests/init.pp00:19
arosenso it's going to take a little while probably.00:19
*** gangil has quit IRC00:20
arosenalight got to bounce. Thanks again everyone for your help getting this up :)00:21
fungijhesketh: how very astute of you. yes i did indeed!00:22
openstackgerritA change was merged to openstack-infra/config: Add a new project stackforge/nova-solver-scheduler  https://review.openstack.org/10813100:24
*** nkubota_ has quit IRC00:25
anteayajeblair: did you not want there to be a third party section in infra-manual? http://docs.openstack.org/infra/manual/third-party.html00:25
*** mfer has quit IRC00:26
*** _nadya_ has quit IRC00:26
anteayajeblair: I had proposed the patch and did hope you would reveiew00:26
*** achanda has joined #openstack-infra00:27
anteayajeblair: https://review.openstack.org/#/c/106736/00:27
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Zuul depends indirectly on lxml  https://review.openstack.org/11080700:27
*** rwsu has quit IRC00:31
*** james_li has joined #openstack-infra00:33
*** marcoemorais has quit IRC00:33
*** marcoemorais has joined #openstack-infra00:33
*** yamahata has joined #openstack-infra00:37
asselinfungi, let me know when you need another test. I have a snapshot so can test easily.00:38
*** hemna is now known as hemna_00:39
*** dims has joined #openstack-infra00:40
*** vermarah_ has quit IRC00:40
*** dims is now known as Guest1915700:40
*** rainya has quit IRC00:41
*** Guest15070 has quit IRC00:41
*** zns has quit IRC00:42
*** james_li has quit IRC00:44
*** james_li has joined #openstack-infra00:44
*** james_li has quit IRC00:44
*** james_li has joined #openstack-infra00:45
*** james_li has quit IRC00:45
*** bradm has quit IRC00:46
*** yamamoto has quit IRC00:47
*** rainya has joined #openstack-infra00:47
*** yjiang5 has quit IRC00:47
ianwfungi: check-tempest-dsvm-centos7: NOT_REGISTERED <- haven't seen that before, know off-hand what it means?00:48
ianw(seen on zuul)00:48
*** roaet_ has quit IRC00:49
*** banix has joined #openstack-infra00:50
*** roaet_ has joined #openstack-infra00:50
ianwhttp://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/launcher/gearman.py#n350 i guess00:50
*** _nadya_ has joined #openstack-infra00:52
*** bodepd has quit IRC00:53
*** jamielennox has quit IRC00:54
anteayaianw: zuul can't find the job00:54
*** Sukhdev has quit IRC00:55
*** unicell has joined #openstack-infra00:55
fungiasselin: if you wanted to test the latest patchset on https://review.openstack.org/110807 and provide feedback on the review, then that would be great00:55
anteayaianw: last time I saw it, configuration called for precise node and the jobs needed trusty00:55
*** jamielennox_ has joined #openstack-infra00:55
*** jamielennox_ is now known as jamielennox00:56
fungiianw: yeah, that's usually a sign that slaves capable of running that job haven't been added to jenkins masters00:56
fungiianw: it could mean that you ran check experimental between when the zuul config change was applied but before jjb finished running on any of the jenkins masters which had the two available nodes for it00:57
*** mfink has joined #openstack-infra00:57
*** mfink has quit IRC00:58
ianwfungi: that seems likely, i'll try again later and see if it just magically fixes itself :)00:58
*** bodepd has joined #openstack-infra00:58
fungicurrently one of jenkins02 or jenkins04 will need to register it00:58
*** shashankhegde has quit IRC00:59
fungiianw: seems to be registered now... http://paste.openstack.org/show/89285/01:00
*** shashankhegde has joined #openstack-infra01:02
anteayaasked not to be disturbed in my room01:03
*** gokrokve has quit IRC01:03
anteayahad three people call so far this morning to confirm I don't want to be disturbed in my room01:03
ianwfungi: great, thanks01:03
*** gokrokve has joined #openstack-infra01:03
fungianteaya: that does indeed sound counterproductive01:03
anteayahopefully we can reduce to a once daily call for the rest of the stay01:04
anteayabut they all have such a sweet accent01:05
*** Guest19157 has quit IRC01:05
fungino doubt they say the same thing about you ;_01:06
*** ramashri has quit IRC01:07
*** gokrokve has quit IRC01:08
anteayafungi: ha ha ha, good point01:09
* anteaya goes in search of food01:11
*** chuckC has quit IRC01:13
*** nkubota has joined #openstack-infra01:17
*** yaguang has joined #openstack-infra01:17
*** bdpayne has quit IRC01:20
*** gangil has joined #openstack-infra01:24
*** emagana has quit IRC01:24
*** emagana_ has joined #openstack-infra01:27
*** IAX has quit IRC01:29
*** otter768 has joined #openstack-infra01:30
*** emagana_ has quit IRC01:31
*** rainya has quit IRC01:33
*** gokrokve has joined #openstack-infra01:34
*** mmaglana has quit IRC01:34
*** yamahata__ has joined #openstack-infra01:34
*** homeless has quit IRC01:36
*** gokrokve has quit IRC01:36
*** gokrokve has joined #openstack-infra01:37
*** asettle has quit IRC01:38
*** yaguang has quit IRC01:38
tchaypoDoes the infra team maintain the etherpad?01:39
tchaypoanteaya: when do you arrive in brisneyland?01:40
pleia2yep01:40
tchaypoI can't get https://etherpad.openstack.org/p/tripleo-incubator-rationalise-ui to load in any browser...01:40
tchaypobut I can't tell if that's just the shitty airport wifi, or something else01:40
*** baohua has joined #openstack-infra01:41
*** gokrokve has quit IRC01:41
pleia2hm, seems to update the count of users on the pad but stuck on "loading" for the content for me too01:42
pleia2need someone who can log into the server to poke around probably01:42
tchaypoah, not just me.01:43
tchaypoin a way that's better...01:43
*** marcoemorais has quit IRC01:47
*** xianghui has joined #openstack-infra01:49
*** yaguang has joined #openstack-infra01:50
*** nosnos has joined #openstack-infra01:50
*** daya_k has joined #openstack-infra01:50
*** gokrokve has joined #openstack-infra01:53
*** gokrokve has quit IRC01:54
*** gokrokve has joined #openstack-infra01:54
*** SumitNaiksatam has quit IRC01:57
*** amotoki has joined #openstack-infra01:57
*** morganfainberg is now known as morganfainberg_Z01:58
*** lttrl has quit IRC01:59
*** crc32 has quit IRC01:59
*** shashankhegde has quit IRC02:00
*** otter768 has quit IRC02:00
*** amotoki has quit IRC02:02
mordredtchaypo, pleia2: there are two stuck abiword processes02:03
*** garyh has joined #openstack-infra02:05
ianwfungi: hmm, another run and still seeing "NOT_REGISTERED"02:05
tchaypo... abiword?02:05
tchaypoisn't that a gui word processor thing?02:06
ianwi guess because it went to jenkins06 : https://jenkins06.openstack.org/job/check-grenade-dsvm-neutron/4579/02:06
tchayposurely you aren't saying that etherpad uses that in the background?02:06
mordredit does to handle the "import from word document" feature02:06
tchaypothat'd be as insane as spinning up openoffice *with a gui* just to convert a word document someone submitted to your web service into html02:06
tchaypo.... *sigh*02:07
mordredyah02:07
StevenK"catdoc" doesn't work?02:09
*** otter768 has joined #openstack-infra02:09
*** garyh has quit IRC02:10
*** Ryan_Lane has quit IRC02:10
anteayatchaypo: arrived this morning, just had food - we can call it lunch02:10
StevenKpleia2: O HAI, how are you feeling?[6~02:11
*** garyh has joined #openstack-infra02:11
StevenKSilly laptop keyboard. I just get used to my desktop keyboard again, and I'm back on the laptop.02:11
*** jyuso has joined #openstack-infra02:12
anteayaStevenK: it is a squid with a hat on02:12
anteaya[6~02:12
StevenKHahaha02:12
*** achanda has quit IRC02:12
*** SumitNaiksatam has joined #openstack-infra02:13
StevenKanteaya: Does lunch time mean you're in Brisbane?02:13
anteayayeah02:13
StevenKExcellent :-)02:13
* StevenK waiting at the gate -- flight boards in roughly 30 minutes02:14
anteayablanched broccoli with fresh lemon juice just made my "addressing jet lag" list02:15
anteayaStevenK: safe flight02:15
*** achanda has joined #openstack-infra02:15
*** chuckC has joined #openstack-infra02:15
StevenKanteaya: It's not really a flight, it's only 80 minutes.02:15
StevenKThat makes it more an annoyance. :-P02:16
anteayayou still have to get frisked, then sit still and listen to the seatbelt and lifejacket chat02:16
anteayaso it is a flight02:16
*** arnaud__ has quit IRC02:17
*** arnaud has quit IRC02:17
StevenKNo frisking. Domestic security is empty your pockets, take laptop out of the bag and walk through a metal detector02:17
tchaypomy flight also boards in about 12 minutes.. so I guess I should think about heading to the gate soon02:18
StevenKAnd there were a whole 2 people in front of me, so I don't get the crowding feeling from international security02:18
anteayaStevenK: nice02:19
StevenKtchaypo: So far, there's one woman here manning the gate desk looking bored02:19
anteayatchaypo: safe flight02:19
StevenKanteaya: tchaypo and I may have to capture you for dinner :-)02:19
*** praneshp has quit IRC02:19
anteayaI went through security in TO and had zero lineup and more agents than I had ever seen, all with nothing to do02:19
anteayaand someone was learning the x-ray02:20
StevenKanteaya: Unless you'd rather do what my wife does when she's travelling and have sleep for dinner02:20
anteayaso I had my bag unpacked and checked02:20
anteayaStevenK: dinner is fine02:20
anteayavegetarian with lots of green vegetables and as little oil as possible is what I need to eat for the rest of the day02:20
anteayaand tomorrow02:20
tchaypokj02:21
tchaypogah02:21
*** asettle has joined #openstack-infra02:21
anteayaStevenK: no, had a 4 hour nap after I arrived, so I should be good until after 8pm tonight, that is my goal02:21
StevenKanteaya: Getting back from Raleigh, my flight landed at 6am -- staying awake until 9:30pm required a fair amount of commitment02:22
anteayaStevenK: no kidding02:22
*** armax has quit IRC02:22
anteayathat was my goal but I had to sleep once I got here02:22
StevenKanteaya: Did you sleep on the plane?02:22
anteayaabout 2 hours02:22
*** garyh has quit IRC02:23
anteayawhich is unbelievalbe for me02:23
anteayamy last best time was 45 minutes02:23
StevenKNice!02:23
anteayaI had a dream the whole time of standing up and finding a bed02:23
StevenKanteaya: I got roughly 9 hours on the way to Raleigh, but I cheated.02:23
anteayaStevenK: drugs?02:23
StevenKanteaya: International business class02:23
anteayaStevenK: ohhhhh02:23
anteayanice02:24
*** mmaglana has joined #openstack-infra02:24
StevenKanteaya: I take Melatonin on flights to help me sleep02:24
anteayaI can't do anything like that02:24
StevenKI got about 6 hours on the way back to Sydney, which wasn't too bad02:24
anteayaI don't sleep mostly because my body would get a kink in it somewhere02:24
anteayaStevenK: cool02:24
anteayaso I actually do my spine good by getting up and walking in place on a regular basis02:25
StevenKanteaya: So being able to lie flat in business class would mean you could sleep?02:25
anteayayes02:25
anteayaI'm waiting for the fifth element style horizontal sleeping chambers02:26
StevenKLike a Japanese capsule hotel?02:26
anteayano drugs for mine, but I woulnd't need them if I was lying flat02:26
anteayayeah02:26
StevenKSome of friends of mine stayed one night in one when they last visited Japan.02:27
StevenKWhich I thought was just madness on their part02:27
anteayawhat did they say about it?02:27
anteayawhy madness?02:27
StevenKanteaya: Cramped, but kind of cool02:27
anteayainteresting02:27
anteayayeah, not much for doing yoga in it02:27
anteayabut better than sleeping in a chair02:28
StevenKanteaya: I prefer some modicum of space in my hotel rooms -- and my own bathroom is also very nice02:28
anteayaoh yes02:28
anteayabut if the choice is airplane seat or capsule, I'm for capsule02:29
StevenKThey should totally fit out an airplane with them02:29
*** mmaglana has quit IRC02:30
*** armax has joined #openstack-infra02:30
*** mmaglana has joined #openstack-infra02:30
anteayaagreed02:31
*** yaguang has quit IRC02:32
*** xianghui has quit IRC02:32
StevenKI'm not sure if it would end up with less or more density, but I haven't thought about it too deeply02:32
*** mfer has joined #openstack-infra02:33
*** xianghui has joined #openstack-infra02:33
*** armax has quit IRC02:33
StevenKHm, a dot-matrix printer has just clattered to life at the gate desk, and there is no one there ...02:34
anteayaStevenK: I did, you would have to reconfigure lugagge02:34
*** mmaglana has quit IRC02:35
anteayaStevenK: ghost in the machine02:35
StevenKHeh02:35
*** yaguang has joined #openstack-infra02:35
* StevenK spies an A380 taxiing02:35
anteayaand if you went with a centre aisle all the pods could be the same length02:35
anteayaand I am thinking you could go 5 high02:36
StevenKanteaya: You could easily stack them 3 high02:36
anteayathen you would have to do sizing based on girth02:36
anteayaI think you could do 5 in some places02:36
anteayaseating would  have a claustraphobia rating02:37
anteayaso the lower your rating the cheaper and smaller your capsule02:37
anteayayou coulnd't even call it seating anymore02:37
*** daya_k has quit IRC02:38
StevenKHaha02:38
*** ArxCruz has quit IRC02:40
*** zul has joined #openstack-infra02:40
*** ArxCruz has joined #openstack-infra02:41
*** jgrimm has joined #openstack-infra02:42
StevenK-> boarding02:42
*** bradm has joined #openstack-infra02:42
*** mfer has quit IRC02:43
*** crc32 has joined #openstack-infra02:45
*** jamielennox is now known as jamielennox|away02:45
*** jamielennox|away is now known as jamielennox02:48
*** Alexandra_ has joined #openstack-infra02:49
anteayaStevenK: enjoy the seatbelt demo02:49
*** asettle has quit IRC02:49
*** xianghui has quit IRC02:49
*** elambert has joined #openstack-infra02:50
*** arnaud has joined #openstack-infra02:54
*** elambert has quit IRC02:55
*** rainya has joined #openstack-infra02:56
*** jp_at_hp has quit IRC02:59
*** jp_at_hp has joined #openstack-infra03:00
*** trinaths has quit IRC03:02
*** xianghui has joined #openstack-infra03:02
*** trinaths has joined #openstack-infra03:03
*** trinaths has quit IRC03:04
*** james_li has joined #openstack-infra03:05
*** ramashri has joined #openstack-infra03:05
*** harlowja is now known as harlowja_away03:06
*** gokrokve_ has joined #openstack-infra03:07
*** nelsnelson has quit IRC03:08
*** sandywalsh has quit IRC03:10
*** gokrokve has quit IRC03:11
*** xianghuihui has joined #openstack-infra03:11
*** sandywalsh has joined #openstack-infra03:11
*** zul has quit IRC03:11
*** xianghui has quit IRC03:12
*** rainya has quit IRC03:12
*** gokrokve_ has quit IRC03:12
*** rainya has joined #openstack-infra03:13
*** aysyd has quit IRC03:13
*** rainya has quit IRC03:15
*** rainya has joined #openstack-infra03:18
*** rainya has quit IRC03:19
*** rainya has joined #openstack-infra03:19
*** nkubota has quit IRC03:20
*** dims has joined #openstack-infra03:20
*** dims is now known as Guest8601403:20
*** nkubota_ has joined #openstack-infra03:21
*** crc32 has quit IRC03:22
*** jdahlin has joined #openstack-infra03:24
*** Azher has joined #openstack-infra03:25
*** daya_k has joined #openstack-infra03:26
*** jp_at_hp has quit IRC03:27
*** yamamoto_ has joined #openstack-infra03:28
*** r1chardj0n3s is now known as r1chardj0n3s_afk03:29
*** yamamot__ has joined #openstack-infra03:29
* anteaya goes for a bit of a walk, will check back in later03:30
*** xianghuihui has quit IRC03:30
*** yaguang has quit IRC03:31
*** yaguang has joined #openstack-infra03:31
*** mmaglana has joined #openstack-infra03:33
*** Alexandra_ has quit IRC03:33
*** yamamoto_ has quit IRC03:33
*** yamahata has quit IRC03:33
*** Alexandra_ has joined #openstack-infra03:33
*** yamahata__ has quit IRC03:34
*** xianghuihui has joined #openstack-infra03:34
*** dstufft|laptop has joined #openstack-infra03:35
*** yamahata has joined #openstack-infra03:35
*** marun has joined #openstack-infra03:35
*** bdpayne has joined #openstack-infra03:39
*** marun has quit IRC03:45
*** nkubota has joined #openstack-infra03:51
*** nosnos has quit IRC03:52
*** james_li has quit IRC03:52
*** nkubota has quit IRC03:52
*** Alexandra_ is now known as a03:54
*** a is now known as alexandra03:55
*** alexandra is now known as a03:55
*** a is now known as asettle03:55
*** boris-42 has quit IRC03:57
*** amotoki has joined #openstack-infra03:58
openstackgerritSpencer Krum proposed a change to openstack-infra/config: First draft of enabling beaker tests to run  https://review.openstack.org/10207103:58
*** stevemar has joined #openstack-infra03:59
*** amotoki has quit IRC04:02
*** jgrimm has quit IRC04:03
*** boris-42 has joined #openstack-infra04:06
*** HenryG is now known as HenryG_afk04:06
*** asettle has quit IRC04:09
*** stevemar has quit IRC04:10
*** gokrokve has joined #openstack-infra04:11
*** asettle has joined #openstack-infra04:13
*** cinerama_ has joined #openstack-infra04:17
*** cinerama_ has quit IRC04:17
*** james_li has joined #openstack-infra04:19
*** james_li has quit IRC04:20
*** gokrokve has quit IRC04:21
*** gokrokve has joined #openstack-infra04:22
*** gokrokve has quit IRC04:26
*** banix has quit IRC04:29
*** stevemar has joined #openstack-infra04:30
*** gangil has quit IRC04:43
*** chandankumar has joined #openstack-infra04:45
*** Guest86014 has quit IRC04:45
*** ramashri has quit IRC04:45
*** nosnos has joined #openstack-infra04:50
*** gokrokve has joined #openstack-infra04:50
*** amotoki has joined #openstack-infra04:51
*** rainya has quit IRC04:54
*** cnesa has joined #openstack-infra04:56
*** yamamot__ has quit IRC05:01
*** oomichi has joined #openstack-infra05:02
*** amotoki has quit IRC05:06
*** praneshp has joined #openstack-infra05:07
*** MarkAtwood has joined #openstack-infra05:08
*** MarkAtwood has quit IRC05:08
*** praneshp_ has joined #openstack-infra05:08
openstackgerritAishwarya Thangappa proposed a change to openstack-infra/storyboard: Adding Subscription Resource Hook  https://review.openstack.org/10284205:09
*** praneshp has quit IRC05:11
*** praneshp_ is now known as praneshp05:11
*** achanda has quit IRC05:17
*** yamamoto_ has joined #openstack-infra05:18
jamielennoxhey all, 2 +2s but no +A on https://review.openstack.org/#/c/108832/ - bumping keystoneclient version, can someone kick it off?05:21
*** asettle has quit IRC05:23
*** achanda has joined #openstack-infra05:26
*** arnaud has quit IRC05:30
*** cody-somerville has quit IRC05:31
*** cody-somerville has joined #openstack-infra05:31
*** derekh_ has joined #openstack-infra05:35
*** bdpayne has quit IRC05:37
*** arnaud has joined #openstack-infra05:37
*** bdpayne has joined #openstack-infra05:45
*** gokrokve_ has joined #openstack-infra05:50
*** k4n0 has joined #openstack-infra05:51
*** jlibosva has joined #openstack-infra05:52
*** gokrokve has quit IRC05:52
*** gokrokve_ has quit IRC05:54
*** ihrachyshka has joined #openstack-infra06:00
*** pcrews has quit IRC06:00
openstackgerritAngus Lees proposed a change to openstack-infra/elastic-recheck: Add query for mysqldb + eventlet deadlock  https://review.openstack.org/11053106:02
*** jcoufal has joined #openstack-infra06:02
*** arnaud has quit IRC06:02
tchaypothanks gus06:03
*** yfried_ has joined #openstack-infra06:04
*** arnaud has joined #openstack-infra06:04
*** achanda has quit IRC06:04
*** ihrachyshka has quit IRC06:04
*** ihrachyshka has joined #openstack-infra06:05
*** flaper87|afk is now known as flaper8706:05
*** zns has joined #openstack-infra06:10
*** zns has quit IRC06:11
*** zns has joined #openstack-infra06:12
*** Longgeek has joined #openstack-infra06:18
*** stevemar has quit IRC06:19
*** Longgeek has quit IRC06:20
*** zns has quit IRC06:20
*** Longgeek has joined #openstack-infra06:22
*** arnaud has quit IRC06:22
*** bdpayne has quit IRC06:30
*** ildikov has quit IRC06:37
*** jamielennox is now known as jamielennox|away06:38
*** doude has joined #openstack-infra06:38
*** nijaba has quit IRC06:42
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Create specs.o.o/index.html  https://review.openstack.org/11075606:43
jogoclarkb mordred: on a plane to australia so about to go offline. but it appears this broke Salvatore and minesweeper06:49
jogoI am afraid that this change is breaking people, not 100% clear exactly why yet, when we should have given people a warning before making the change06:49
*** e0ne has joined #openstack-infra06:49
*** nijaba has joined #openstack-infra06:50
jogoclarkb mordred: see the linked ML thread I refered too06:51
*** oomichi_ has joined #openstack-infra06:52
*** oomichi has quit IRC06:52
ihrachyshkaso we still get issues in havana with centos machines without libffi-devel installed: http://logs.openstack.org/periodic-stable/periodic-nova-python26-havana/11c061d/console.html06:55
ihrachyshkaany ideas where to fix it? or who can handle that?06:55
*** reed has joined #openstack-infra06:56
openstackgerritJoe Gordon proposed a change to openstack-infra/elastic-recheck: Add fingerprint for bug 1350466  https://review.openstack.org/11073706:56
uvirtbotLaunchpad bug 1350466 in nova "deadlock in scheduler expire reservation periodic task" [Undecided,New] https://launchpad.net/bugs/135046606:57
*** reed has quit IRC06:57
*** afazekas has joined #openstack-infra06:57
openstackgerritRadomir Dopieralski proposed a change to openstack/requirements: Upgrade xstatic-bootstrap-scss to at least version 3  https://review.openstack.org/11086606:59
*** ArxCruz has quit IRC07:01
*** _nadya_ has quit IRC07:04
*** e0ne has quit IRC07:07
openstackgerritA change was merged to openstack-infra/devstack-gate: Adds DVR related env variable to devstack-vm-gate.sh  https://review.openstack.org/10690107:09
*** lukego has joined #openstack-infra07:10
*** camunoz has quit IRC07:12
*** p5ntangle has joined #openstack-infra07:12
*** oomichi_ has quit IRC07:14
*** jdahlin has quit IRC07:17
*** mpaolino has joined #openstack-infra07:21
*** ihrachyshka has quit IRC07:23
*** ildikov has joined #openstack-infra07:26
*** luqas has joined #openstack-infra07:33
*** hashar has joined #openstack-infra07:34
*** derekh_ is now known as derekh_afk07:34
*** derekh_afk is now known as derekh__07:36
*** mancdaz has joined #openstack-infra07:37
*** praneshp has quit IRC07:39
*** jedimike has joined #openstack-infra07:40
*** jistr has joined #openstack-infra07:42
*** andreykurilin has joined #openstack-infra07:45
*** pblaho has joined #openstack-infra07:45
*** mmaglana has quit IRC07:46
*** dstufft|laptop has quit IRC07:46
*** freyes has joined #openstack-infra07:46
*** e0ne has joined #openstack-infra07:46
*** derekh__ has quit IRC07:47
*** yamahata has quit IRC07:51
*** jerryz_ has joined #openstack-infra07:52
*** skolekonov has joined #openstack-infra07:57
*** jerryz_ has quit IRC07:59
*** jpich has joined #openstack-infra07:59
*** Longgeek has quit IRC08:04
*** Longgeek has joined #openstack-infra08:05
*** che-arne|2 has quit IRC08:09
*** derekh_ has joined #openstack-infra08:16
*** rcarrillocruz has joined #openstack-infra08:24
*** nosnos has quit IRC08:26
*** nosnos has joined #openstack-infra08:26
*** rcarrill` has quit IRC08:27
*** zns has joined #openstack-infra08:33
*** zns has quit IRC08:34
*** zns has joined #openstack-infra08:35
*** mmaglana has joined #openstack-infra08:35
*** yamamoto_ has quit IRC08:36
*** mmaglana_ has joined #openstack-infra08:37
*** mmaglana has quit IRC08:40
*** _nadya_ has joined #openstack-infra08:40
*** mmaglana_ has quit IRC08:41
*** e0ne has quit IRC08:41
*** leopoldj has joined #openstack-infra08:43
*** xianghuihui has quit IRC08:45
*** xianghui has joined #openstack-infra08:45
*** e0ne has joined #openstack-infra08:46
*** andreykurilin has quit IRC08:46
*** jp_at_hp has joined #openstack-infra08:47
*** luqas has quit IRC08:49
*** ZZelle has quit IRC08:51
*** Guest31978 has joined #openstack-infra08:52
*** ZZelle has joined #openstack-infra08:52
*** yamamoto has joined #openstack-infra08:53
*** jp_at_hp has quit IRC08:58
*** mkerrin has quit IRC08:59
*** ihrachyshka has joined #openstack-infra09:04
*** mkerrin has joined #openstack-infra09:05
*** amuller has joined #openstack-infra09:07
*** ityaptin has joined #openstack-infra09:08
*** jp_at_hp has joined #openstack-infra09:09
*** che-arne has joined #openstack-infra09:12
*** roaet_ has quit IRC09:12
*** dtroyer has quit IRC09:12
*** pabelanger has quit IRC09:12
*** pabelanger has joined #openstack-infra09:13
*** dtroyer has joined #openstack-infra09:14
*** roaet_ has joined #openstack-infra09:15
*** rlandy has joined #openstack-infra09:20
*** baohua has quit IRC09:30
*** oanufriev has joined #openstack-infra09:34
*** hashar_ has joined #openstack-infra09:35
*** mmaglana has joined #openstack-infra09:35
*** xianghui has quit IRC09:36
*** luqas has joined #openstack-infra09:37
*** flaper87 is now known as flaper87|afk09:38
*** hashar has quit IRC09:38
*** mmaglana has quit IRC09:40
*** bauzas has joined #openstack-infra09:47
*** unicell has quit IRC09:48
*** yaguang has quit IRC09:52
*** hashar_ is now known as hashar09:55
*** andreaf has joined #openstack-infra10:02
*** e0ne has quit IRC10:04
*** e0ne has joined #openstack-infra10:05
*** ociuhandu has quit IRC10:17
*** jyuso has quit IRC10:20
*** Azher has quit IRC10:26
*** doude has quit IRC10:29
*** unicell has joined #openstack-infra10:31
*** doude has joined #openstack-infra10:35
*** jcoufal_ has joined #openstack-infra10:37
*** jcoufal has quit IRC10:40
*** wilfredo has joined #openstack-infra10:41
*** nkubota_ is now known as zz_nkubota_10:42
*** banix has joined #openstack-infra10:44
*** pcm_ has joined #openstack-infra10:46
*** penguinRaider__ has quit IRC10:48
*** penguinRaider__ has joined #openstack-infra10:50
*** wilfredo has quit IRC10:58
*** zns has quit IRC10:59
*** oanufriev has quit IRC11:00
*** ociuhandu has joined #openstack-infra11:03
*** zns has joined #openstack-infra11:04
*** vhoward has joined #openstack-infra11:04
*** ociuhandu_ has joined #openstack-infra11:06
*** ociuhandu has quit IRC11:08
*** ociuhandu_ is now known as ociuhandu11:08
*** dmsimard_away is now known as dmsimard11:15
*** pcm_ has quit IRC11:17
*** pcm_ has joined #openstack-infra11:20
openstackgerritSergey Skripnick proposed a change to openstack-infra/devstack-gate: Uncomment NUMBER_FAKE_NOVA_COMPUTE  https://review.openstack.org/11090711:23
openstackgerritSergey Skripnick proposed a change to openstack-infra/devstack-gate: Uncomment NUMBER_FAKE_NOVA_COMPUTE  https://review.openstack.org/11090711:25
*** sandywalsh has quit IRC11:28
*** Longgeek_ has joined #openstack-infra11:28
*** Longgeek has quit IRC11:31
*** luqas has quit IRC11:32
openstackgerritChristian Berendt proposed a change to openstack/requirements: Remove unneeded definitions of Python Source Code Encoding  https://review.openstack.org/11091211:32
*** mmaglana has joined #openstack-infra11:35
*** flaviof_zzz is now known as flaviof11:36
*** flaper87|afk is now known as flaper8711:36
ttxfungi: there is a bit of an issue with the stable-maint group ownership (https://review.openstack.org/#/admin/groups/120,info)11:37
ttxfungi: the group is self-owned, and some people were added by who-knows-who11:37
ttxfungi: ideally that group should be owned by "Release Managers"11:38
ttxI can't make the change myself though11:38
*** otter768 has quit IRC11:40
*** mmaglana has quit IRC11:40
openstackgerritSergey Skripnick proposed a change to openstack-infra/config: Add rally job for heat with fake_virt  https://review.openstack.org/11092011:41
fungittx: i'll fix it11:41
ttxfungi: thx!11:42
*** banix has quit IRC11:42
fungittx: changed11:43
*** ArxCruz has joined #openstack-infra11:49
*** ArxCruz has quit IRC11:49
*** zz_nkubota_ is now known as nkubota11:58
*** adalbas has joined #openstack-infra11:58
*** weshay has joined #openstack-infra11:59
*** wilfredo has joined #openstack-infra11:59
*** daya_k has quit IRC12:01
*** e0ne has quit IRC12:04
openstackgerrityolanda.robla proposed a change to openstack-infra/config: Add logging to manage-projects calls  https://review.openstack.org/11092612:04
*** Shrews has joined #openstack-infra12:04
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Allign sahara's tag acls with integrated projects  https://review.openstack.org/10571112:05
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Add specific python-saharaclient acls  https://review.openstack.org/10571212:05
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Use sahara-specs-core for sahara-specs acl  https://review.openstack.org/11092712:05
*** dkranz has joined #openstack-infra12:05
*** zns has quit IRC12:06
*** pdmars has joined #openstack-infra12:06
*** pdmars has joined #openstack-infra12:07
*** alexpilotti has joined #openstack-infra12:10
*** baohua has joined #openstack-infra12:10
*** k4n0 has quit IRC12:14
*** hashar has quit IRC12:14
openstackgerrityolanda.robla proposed a change to openstack-infra/config: Debian and Ubuntu>Precise needs bundler package, not ruby-bundler  https://review.openstack.org/10864912:14
*** fanhe has joined #openstack-infra12:16
*** e0ne has joined #openstack-infra12:18
*** kgiusti has joined #openstack-infra12:19
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Adding Search endpoints and sqlalchemy impl  https://review.openstack.org/10147612:22
*** ArxCruz has joined #openstack-infra12:23
*** zns has joined #openstack-infra12:24
*** jgallard has joined #openstack-infra12:28
*** che-arne has quit IRC12:28
*** che-arne has joined #openstack-infra12:30
adalbasanteaya, sdague : I have a blog post about continuous integration I would like to publish. Do I need to be author in the blog for that or should I send it for review?12:32
*** cdub has joined #openstack-infra12:34
*** dkranz has quit IRC12:35
*** aysyd has joined #openstack-infra12:36
*** p5ntangle has quit IRC12:38
*** p5ntangle has joined #openstack-infra12:38
*** nosnos has quit IRC12:40
openstackgerritLadislav Smola proposed a change to openstack/requirements: Update xstatic-rickshaw to >= 1.5.0  https://review.openstack.org/11094812:40
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Assign CentOS 7 DevStack jobs to correct nodes  https://review.openstack.org/11094912:40
*** flaviof is now known as flaviof_zzz12:46
*** zns has quit IRC12:47
*** dkranz has joined #openstack-infra12:47
*** HenryG_afk is now known as HenryG12:49
*** bknudson has quit IRC12:50
*** luqas has joined #openstack-infra12:53
joafungi: around ?12:56
*** julim has joined #openstack-infra12:59
*** mwagner_lap has joined #openstack-infra12:59
*** julim has quit IRC13:00
*** p5ntangl_ has joined #openstack-infra13:00
*** nelsnelson has joined #openstack-infra13:00
*** andreaf_ has joined #openstack-infra13:01
*** HenryG has quit IRC13:02
*** nkubota is now known as zz_nkubota13:04
*** p5ntangle has quit IRC13:04
*** julim has joined #openstack-infra13:04
*** andreaf has quit IRC13:04
*** dkranz has quit IRC13:05
*** hashar has joined #openstack-infra13:07
*** Shrews has left #openstack-infra13:07
*** bknudson has joined #openstack-infra13:08
*** thedodd has joined #openstack-infra13:11
*** dkehn_ has joined #openstack-infra13:12
*** chuckC_ has joined #openstack-infra13:12
*** pdmars_ has joined #openstack-infra13:13
*** gargola__ has joined #openstack-infra13:14
*** yamahata__ has joined #openstack-infra13:14
*** yamamoto_ has joined #openstack-infra13:14
*** koolhead17 has joined #openstack-infra13:14
*** eglynn-regus has joined #openstack-infra13:15
*** unicell has quit IRC13:15
*** gaelL has quit IRC13:15
*** dkehn has quit IRC13:15
*** beekneemech has joined #openstack-infra13:15
*** yamahata_ has quit IRC13:15
*** clarkb has quit IRC13:15
*** bnemec has quit IRC13:15
*** sdague has quit IRC13:15
*** pdmars has quit IRC13:15
*** mpaolino has quit IRC13:15
*** chuckC has quit IRC13:15
*** timrc has quit IRC13:15
*** chuckC_ is now known as chuckC13:15
*** mwagner_lap has quit IRC13:15
*** yamamoto has quit IRC13:15
*** primeministerp has quit IRC13:15
*** dkehnx has quit IRC13:15
*** zehicle_at_dell has quit IRC13:15
*** eglynn-officeafk has quit IRC13:15
*** anteaya has quit IRC13:15
*** chandankumar has quit IRC13:15
*** gargola has quit IRC13:15
*** mattymo has quit IRC13:15
*** zehicle_at_dell has joined #openstack-infra13:15
*** unicell has joined #openstack-infra13:15
*** mwagner_lap has joined #openstack-infra13:15
*** mpaolino has joined #openstack-infra13:15
*** timrc has joined #openstack-infra13:15
*** sdague has joined #openstack-infra13:16
*** dkehn has joined #openstack-infra13:16
*** e0ne has quit IRC13:16
*** gaelL has joined #openstack-infra13:16
*** chandankumar has joined #openstack-infra13:16
*** primeministerp has joined #openstack-infra13:16
*** clarkb has joined #openstack-infra13:16
*** anteaya has joined #openstack-infra13:16
*** eharney has joined #openstack-infra13:17
*** dkliban has joined #openstack-infra13:17
*** dkehn_ is now known as dkehnx13:18
*** dustins has joined #openstack-infra13:19
*** mattymo has joined #openstack-infra13:20
*** rainya has joined #openstack-infra13:20
*** samy has joined #openstack-infra13:22
*** samy is now known as Guest3557813:22
DinaBelovajhesketh, o/13:24
DinaBelovayou here?13:24
jheskethHey DinaBelova13:24
DinaBelovaabout the https://review.openstack.org/#/c/110247/13:24
jheskethI am, but it's 1130pm and I'm about to head off13:24
DinaBelovaoh, sorry :)13:24
DinaBelovanow I know your TZ :D13:25
jheskethheh, all good13:25
DinaBelovaokay, so let's move this for tomorrow..13:25
jheskethI'd like to help, but I think that change needs baby sitting13:25
DinaBelovajust have no idea what happened there - I went through the logs and they seem not having any actual reason..13:25
DinaBelovajhesketh, hehe, what do you mean by 'baby sitting' here?13:26
DinaBelovawell, anyway :)13:26
jheskethheh, I mean sticking around so that when the world blows up we haven't bravely run off to not fix it13:26
*** dangers_away is now known as dangers13:30
DinaBelova:D13:30
*** banix has joined #openstack-infra13:30
jp_at_hpQuick question on oslo.rootwrap/1.3.0.0a1 - is there a policy not to include it in global-requirements, or will it get added as a constraint now that teams are starting to add it to their own project requirements?  Is there somewhere I can see docs on the process that causes global-requirements to be updated?13:30
jheskethanyways, I'm going to get some sleep. I have to help run the openstack miniconf at pycon-au.org tomorrow morning!13:31
DinaBelovajhesketh, good night :)13:31
*** banix has quit IRC13:31
*** banix has joined #openstack-infra13:32
openstackgerritDolph Mathews proposed a change to openstack-infra/elastic-recheck: add query for unmet dependencies  https://review.openstack.org/11095613:32
*** fanhe has quit IRC13:33
*** banix has quit IRC13:34
*** zul has joined #openstack-infra13:34
*** p5ntangl_ has quit IRC13:36
*** nelsnelson has quit IRC13:36
*** crc32 has joined #openstack-infra13:36
*** p5ntangle has joined #openstack-infra13:36
*** nelsnelson has joined #openstack-infra13:37
*** dustins has quit IRC13:38
*** banix has joined #openstack-infra13:38
*** thedodd has quit IRC13:39
*** dustins has joined #openstack-infra13:39
*** pcrews has joined #openstack-infra13:41
*** mfer has joined #openstack-infra13:42
*** nelsnelson has quit IRC13:42
*** Shrews has joined #openstack-infra13:44
fungijoa: what was the question?13:46
*** prad has joined #openstack-infra13:47
fungijp_at_hp: http://git.openstack.org/cgit/openstack/requirements/tree/global-requirements.txt#n58 has oslo.rootwrap>=1.3.0.0a113:47
*** esker has joined #openstack-infra13:48
fungijp_at_hp: the git blame trail leads to https://review.openstack.org/10933813:49
jp_at_hpfungi: yeah - maybe I shoulda looked first, sorry ;)  But that was quite a while ago.  any reason it hasn't populated pypi.openstack.org?13:49
*** dims has joined #openstack-infra13:49
fungijp_at_hp: i see it at http://pypi.openstack.org/simple/oslo.rootwrap/13:49
*** dims is now known as Guest9492113:50
*** needscoffee has joined #openstack-infra13:50
*** needscoffee has quit IRC13:50
*** needscoffee has joined #openstack-infra13:50
*** salv-orlando has joined #openstack-infra13:50
fungijp_at_hp: do you have some process using our mirror (not a great idea)? if so, you may be using our old mirror. we've updated all our ci to use our current mirror13:50
*** rcarrill` has joined #openstack-infra13:50
jp_at_hpI was looking at http://pypi.openstack.org/openstack/oslo.rootwrap/13:50
jp_at_hpso I guess that's the old mirror?13:50
fungijp_at_hp: yep. that's the old abandoned mirror. we should just delete it to make it more obvious. i'll get some consensus from the rest of the team today hopefully13:51
*** homeless has joined #openstack-infra13:51
*** arnaud__ has joined #openstack-infra13:51
jp_at_hpfungi: thanks - even just an addition to the index to warn would be helpful...13:51
jp_at_hpmight make me not ask stupid questions in future.13:52
fungijp_at_hp: probably better to just delete it so that it's immediately broken for anyone using it, rather than subtly broken but stale. most people who are going to be affected won't likely go there with a web browser and wouldn't see any message we posted on it as a result13:52
jp_at_hpeither works for me :D13:53
joafungi: I was wondering, for a cinder-specific CI set up (testing a vendor driver specifically), how is managed the specific configuration ? I can't seem to find any relevant script. Does it use any pre-installed configuration file; or does the devstack setup erase all that ?13:53
*** rcarrillocruz has quit IRC13:53
jp_at_hpa little knowledge... I figured since it wasn't in the mirror it couldn't be in global-requirements, so didn't check :(13:53
fungijp_at_hp: that was true of the old mirror (back when we were updating it) but now we run a full pypi mirror using a tool called bandersnatch13:54
fungiso we pull anything which is on pypi.python.org into our mirror even if it's not actually used by openstack13:54
fungijoa: we use something called devstack-gate to construct a devstack localrc based on a bunch of different environment variables13:55
fungijoa: https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/13:55
*** zz_dimtruck is now known as dimtruck13:55
fungijoa: it's basically just a collection of shell scripts which assemble the test scenario/configuration13:56
jp_at_hpoh yeah - the tool that doesn't work behind proxies :(13:56
fungijp_at_hp: i hear they're working to solve proxy support in bandersnatch since the python community is settling on it as the "one true way" to run a full pypi mirror13:56
jp_at_hpI'll look forward ot that13:57
fungijp_at_hp: though we're also talking about sticking our mirror on an afs backend, in which case you could just mount it with an afs client and, if desired, rsync it to another local filesystem or something13:57
jp_at_hpwell, if that happens and becomes an option, it'll be something to consider.  I knida like things that are here now and working ;)13:59
fungime too13:59
*** mfer has quit IRC13:59
dansmithis something up with gerrit? I'm getting a weird error trying to save a comment14:00
fungidansmith: no idea... details?14:00
joafungi: Soo, let's assume that I need a specific cinder configuration (or at least a few parameters). Those can be set as variables into the localrc ? Or is there another advised way ?14:00
dansmithfungi: "Invalid authentication method. In order to authenticate, prefix the REST endpoint URL with /a/ (e.g. http://example.com/a/projects/)."14:01
joa(I saw the devstack-gate repo and some scripts)14:01
dansmithfungi: I just logged in about five minutes ago, so my auth should be good14:01
fungidansmith: weird. that's coming from the rest api, not the webui14:01
dansmithfungi: yeah, seems that way, but it's when I click the save button on an inline comment14:02
*** eglynn-regus is now known as eglynn-office14:02
fungidansmith: definitely nothing out of the ordinary on the cacti graphs for the server. what's the review url?14:02
dansmithfungi: https://review.openstack.org/#/c/101355/5/nova/tests/objects/test_fields.py,cm14:02
fungimay be something subtly corrupted with it somehow14:02
*** signed8bit has joined #openstack-infra14:02
*** rainya has quit IRC14:03
fungidansmith: you're getting that when trying to add an inline comment on that file?14:03
dansmithfungi: yep, line 23614:03
dansmithfungi: let me open a new browser and try from scratch14:03
dansmithfungi: just didn't want to lose my comment in the buffer, but I'll save it somewhere14:04
fungii can add a comment on that line, but it may have to do with something going on in your browser session or the specific comment contents14:04
dansmithfungi: ah, navigating anywhere in gerrit gives me that again14:04
*** needscoffee has quit IRC14:04
dansmithfungi: so maybe something up with my token or something.. just so weird14:04
fungiokay, so your session went sideways14:04
fungithat's not the usual error message i get when that happens14:05
dansmith'cause I *just* signed in14:05
fungimostly what i run into is when i sign in with one tab but i already had another review tab open, and then i try to do things in that other tab without refreshing it first14:05
dansmithyeah14:05
*** chandankumar has quit IRC14:05
fungibut in that case it just complains that my session's expired and i need to log in again14:06
dansmithfungi: okay, log out and back in worked, but still.. weird14:06
dansmithfungi: yeah, that's what I'm used to14:06
funginoted. i'll keep an eye out for it in case it's not just you14:06
dansmithokie, thanks14:06
*** che-arne has quit IRC14:07
fungijoa: so, localrc is a mechanism for configuring devstack... you may need a custom hook for devstack if you need to add some machinery which it doesn't have integrated support for (new configuration options and such)14:07
joafungi: Well, I guessed there should be a proper way to do it already, since I doubt I'm the first to setup cI for a vendor-driver in cinder, but you might not know of it ?14:08
fungijoa: i can show you some examples of jobs we run which export custom hook functions to extend devstack-gate14:08
joayeah, it would be great at least as an example14:08
joaI'll see afterwards what I can make of it14:08
fungijoa: but no, i don't really know what the other third-party ci systems are doing to support custom cinder drivers. it could just be that you need to pass a configuration variable into devstack's localrc to tell it what backend driver to use... that's probably a question for your third-party ci peers or maybe the devstack maintainers in #openstack-qa14:09
*** zns has joined #openstack-infra14:10
*** otherwiseguy has joined #openstack-infra14:10
*** oomichi has joined #openstack-infra14:10
joamhh okay14:10
joamight be a good idea to ask there then14:10
*** garyh has joined #openstack-infra14:10
*** ZZelle has quit IRC14:11
joathanks :)14:11
*** ZZelle has joined #openstack-infra14:11
*** wilfredo has quit IRC14:13
*** zul has quit IRC14:15
*** p5ntangl_ has joined #openstack-infra14:16
*** nelsnelson has joined #openstack-infra14:16
*** signed8bit has quit IRC14:16
*** p5ntangl_ has quit IRC14:16
*** armax has joined #openstack-infra14:16
*** rainya has joined #openstack-infra14:16
*** signed8bit has joined #openstack-infra14:16
*** wilfred has joined #openstack-infra14:16
*** Azher has joined #openstack-infra14:17
*** homeless has quit IRC14:17
*** pcm_ has quit IRC14:17
*** oomichi has quit IRC14:17
*** rainya__ has joined #openstack-infra14:18
*** oomichi has joined #openstack-infra14:18
*** p5ntangle has quit IRC14:19
*** pblaho has quit IRC14:19
*** rainya has quit IRC14:19
*** e0ne has joined #openstack-infra14:20
*** timrc is now known as timrc-afk14:21
*** garyh has quit IRC14:22
*** homeless has joined #openstack-infra14:22
*** sandywalsh has joined #openstack-infra14:26
*** devanand1 is now known as devananda14:27
*** esker has quit IRC14:28
*** esker has joined #openstack-infra14:28
*** timrc-afk is now known as timrc14:29
*** stevemar has joined #openstack-infra14:30
*** yamahata__ has quit IRC14:31
*** hashar has quit IRC14:31
*** rainya__ has quit IRC14:31
*** adalbas has quit IRC14:32
*** rainya has joined #openstack-infra14:32
*** esker has quit IRC14:33
*** oomichi has quit IRC14:34
*** samy_ has joined #openstack-infra14:36
*** mkoderer has joined #openstack-infra14:36
*** mfer has joined #openstack-infra14:37
*** Guest35578 has quit IRC14:37
*** Longgeek has joined #openstack-infra14:38
*** gargola__ is now known as gargola14:40
*** Longgeek_ has quit IRC14:41
*** jcoufal_ has quit IRC14:41
*** mfer has quit IRC14:41
*** rwsu has joined #openstack-infra14:42
*** HenryG has joined #openstack-infra14:43
*** adalbas has joined #openstack-infra14:44
*** rainya has quit IRC14:44
*** marun has joined #openstack-infra14:45
*** jgrimm has joined #openstack-infra14:46
*** zns has quit IRC14:46
*** rainya has joined #openstack-infra14:47
*** mfer has joined #openstack-infra14:48
*** thedodd has joined #openstack-infra14:49
*** rainya has quit IRC14:49
*** Guest94921 has quit IRC14:50
*** zns has joined #openstack-infra14:50
*** morganfainberg_Z is now known as morganfainberg14:51
*** gokrokve has joined #openstack-infra14:52
*** datsun180b has joined #openstack-infra14:53
*** p5ntangle has joined #openstack-infra14:53
*** kgriffs has joined #openstack-infra14:54
*** annegent_ has joined #openstack-infra14:54
*** mmaglana has joined #openstack-infra14:54
*** baohua has quit IRC14:55
*** james_li has joined #openstack-infra14:56
*** ihrachyshka has quit IRC14:57
*** rainya has joined #openstack-infra14:57
*** signed8bit has quit IRC14:58
*** signed8bit has joined #openstack-infra14:59
*** flaper87 is now known as flaper87|afk15:01
*** annegent_ has quit IRC15:03
*** annegent_ has joined #openstack-infra15:04
*** smcginnis has joined #openstack-infra15:05
*** sandywalsh has quit IRC15:07
*** garyh has joined #openstack-infra15:07
*** yfried_ has quit IRC15:08
*** esker has joined #openstack-infra15:09
*** dkranz has joined #openstack-infra15:12
*** banix has quit IRC15:12
openstackgerritA change was merged to openstack-infra/config: Assign CentOS 7 DevStack jobs to correct nodes  https://review.openstack.org/11094915:14
*** UtahDave has joined #openstack-infra15:14
*** UtahDave has left #openstack-infra15:15
*** mfer has quit IRC15:15
*** p5ntangle has quit IRC15:15
fungiianw: ^ i'll rerun check experimental on the change you were testing once zuul's updated with that15:17
*** atiwari has joined #openstack-infra15:20
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Silence drupal cron job  https://review.openstack.org/11099215:21
*** homeless_ has joined #openstack-infra15:27
*** gargola is now known as gargoleitor15:29
*** gargoleitor is now known as gargola15:30
*** homeless has quit IRC15:30
*** homeless has joined #openstack-infra15:31
*** emagana has joined #openstack-infra15:31
*** homeless_ has quit IRC15:33
*** IAX has joined #openstack-infra15:37
*** dimtruck is now known as zz_dimtruck15:38
*** arnaud__ has quit IRC15:38
*** AJaeger has quit IRC15:39
*** morganfainberg is now known as morganfainberg_Z15:39
*** Azher has quit IRC15:39
*** arnaud__ has joined #openstack-infra15:40
*** thedodd has quit IRC15:40
*** thedodd has joined #openstack-infra15:41
*** zz_dimtruck is now known as dimtruck15:41
*** banix has joined #openstack-infra15:42
*** morganfainberg_Z is now known as morganfainberg15:44
*** gyee has joined #openstack-infra15:45
*** julim has quit IRC15:48
phschwartzHeads up, you guys might hear other complaints. I talked with Todd and opened an issue. The problem I had with my talk summisions (even thought they did go through), also cut a co-speaker off and I had to re-add him15:50
phschwartz:( I think it was safari related. Damn me for trying to save battery power.15:50
*** rcarrillocruz has joined #openstack-infra15:51
fungigood to know--thanks!15:51
*** rcarrill` has quit IRC15:52
*** jcoufal has joined #openstack-infra15:52
*** nelsnelson has quit IRC15:52
*** crc32 has quit IRC15:54
*** nelsnelson has joined #openstack-infra15:55
*** nelsnels_ has joined #openstack-infra15:55
*** nelsnels_ has quit IRC15:56
*** ihrachyshka has joined #openstack-infra15:57
*** sandywalsh has joined #openstack-infra15:57
sdagueadalbas: I'm not sure I understand your question about blog authoring15:58
*** nelsnelson has quit IRC15:59
*** nelsnelson has joined #openstack-infra15:59
*** garyh has quit IRC16:01
fungiianw: success! (but also exciting new failure!) http://logs.openstack.org/16/110516/2/experimental/check-tempest-dsvm-centos7/53ed92f/console.html#_2014-07-31_15_59_39_52316:01
*** zns_ has joined #openstack-infra16:01
*** emagana has quit IRC16:01
*** arnaud__ has quit IRC16:02
*** zns has quit IRC16:02
*** koolhead17 has quit IRC16:02
*** emagana has joined #openstack-infra16:02
*** mfer has joined #openstack-infra16:02
krotscheckAny Infra core out there (other than jeblair) feel like a nice, juicy puppet review? https://review.openstack.org/#/c/98007/16:03
krotscheckmordred: How’s your week been, any opportunity to do a launchpad import?16:03
*** emagana_ has joined #openstack-infra16:04
*** emagana has quit IRC16:04
*** lukego has quit IRC16:06
openstackgerritA change was merged to openstack-infra/config: Publish barbican developer documentation to docs.openstack.org  https://review.openstack.org/10793516:06
*** ramashri has joined #openstack-infra16:07
*** pcm_ has joined #openstack-infra16:07
*** skolekonov has quit IRC16:07
*** shashankhegde has joined #openstack-infra16:08
*** eharney has quit IRC16:08
*** dims has joined #openstack-infra16:10
*** dims is now known as Guest2133116:10
*** e0ne has quit IRC16:11
*** pcm_ has quit IRC16:11
*** hogepodge has quit IRC16:12
*** sandywalsh has quit IRC16:15
*** gokrokve has quit IRC16:17
*** marcoemorais has joined #openstack-infra16:17
*** emagana_ has quit IRC16:18
*** dimtruck is now known as zz_dimtruck16:18
*** mmaglana has quit IRC16:18
*** julim has joined #openstack-infra16:18
*** emagana has joined #openstack-infra16:18
*** crc32 has joined #openstack-infra16:18
*** mmaglana has joined #openstack-infra16:19
armaxguys thanks again for approving the infra-related dvr patches…we’re successfully running Neutron DVR experimental jobs :)16:22
*** nelsnelson has quit IRC16:23
*** mmaglana has quit IRC16:23
*** emagana has quit IRC16:23
*** emagana has joined #openstack-infra16:24
adalbassdague, i want to make a blog post in the openstack blog section. how can i do that?16:24
sdagueadalbas: you can add yourself to the planet16:26
adalbassdague, ok, so it should go by the community, instead of the main blogging.16:28
sdagueyeh16:29
adalbasok, i found the info now. tks!16:29
*** mfer has quit IRC16:29
*** leopoldj has quit IRC16:30
*** mfer has joined #openstack-infra16:30
*** emagana has quit IRC16:31
*** jgallard has quit IRC16:32
*** _nadya_ has quit IRC16:32
*** ildikov has quit IRC16:33
*** luqas has quit IRC16:33
*** emagana has joined #openstack-infra16:34
*** jistr has quit IRC16:35
pleia2good morning16:36
*** shashankhegde has quit IRC16:36
*** flaviof_zzz is now known as flaviof16:36
morganfainbergpleia2, morning :)16:36
*** mfer has quit IRC16:37
*** dustins has quit IRC16:38
*** dustins has joined #openstack-infra16:39
*** dustins has quit IRC16:39
*** dustins has joined #openstack-infra16:39
*** mpaolino has quit IRC16:40
*** zz_dimtruck is now known as dimtruck16:42
*** mmaglana has joined #openstack-infra16:43
*** gokrokve has joined #openstack-infra16:43
*** flaviof is now known as flaviof_zzz16:45
*** mfer has joined #openstack-infra16:48
openstackgerritafazekas proposed a change to openstack-infra/devstack-gate: Neutron default tenant network type vxlan  https://review.openstack.org/10556916:49
*** thedodd has quit IRC16:49
ctraceyhello infra. had a question about log retention.16:50
ctraceyare build logs discarded on a periodic basis?16:50
ctraceyI am looking for some havana build logs with no luck16:51
jeblairctracey: we keep them for about 4 months16:51
clarkbjogo the fix is to fix minesweeper not go back to precise16:51
ctraceyouch16:51
*** bookwar has joined #openstack-infra16:51
jeblair(we'd like to keep them longer, but, well, we ran out of space)16:51
jeblair(we're working on putting them in swift and hope we can increase the retention period again when that's done)16:51
*** reed has joined #openstack-infra16:52
*** bdpayne has joined #openstack-infra16:52
ctraceyok - i understand.16:52
*** garyh has joined #openstack-infra16:52
jeblair(4 months is about 9 tb)16:52
ctraceythat is less than ideal for a number of reasons tho...must say16:52
fungictracey: here's what the current (compressed!) log storage looks like for 4 months retention http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=717&rra_id=all16:53
ctraceythere is no way to know what dependencies were pulled in by pip16:53
*** thedodd has joined #openstack-infra16:53
ctraceyin the very least, perhaps we should augment the build process to retain that information16:54
fungii'm amazed that we seem to have turned a corner with log volume and it's now trending downward16:54
jeblairprobably expring those _huge_ debug logs16:54
clarkbthat16:54
*** dkehn_ has joined #openstack-infra16:54
clarkbwe made noise and it seems to have helped :)16:54
ctraceyor perhaps I should pose that as a question...16:54
fungictracey: what's the specific use case of knowing what packages were tested during a job which ran 4 months ago?16:54
openstackgerritafazekas proposed a change to openstack-infra/devstack-gate: Neutron default tenant network type vxlan  https://review.openstack.org/10556916:54
clarkbalso mysql slow logs16:54
openstackgerritafazekas proposed a change to openstack-infra/devstack-gate: multi-node dg setup  https://review.openstack.org/10604316:55
ctraceyfungi: getting the same bits on a box16:55
*** mmaglana has quit IRC16:55
phschwartzfungi: Just to give you the heads up, we have been working on a quick script that can track and prune dead deletes across our env's, but not easy due to the seperation of our api's.16:55
fungictracey: have a particular patch+job in mind?16:55
ctraceywell...this is the first time i ran into this specific issue16:56
fungictracey: just trying to figure out where people are wanting to repeat jobs from so long ago16:56
*** eharney has joined #openstack-infra16:56
ctraceyfungi: yeah...good questions :)16:56
fungiphschwartz: awesome--that'll help tremendously until your nova patch is in use16:56
*** banix has quit IRC16:56
ctraceyfungi: I have a tool that builds system packages from a specific git ref16:56
*** dkehn has quit IRC16:57
*** arnaud__ has joined #openstack-infra16:57
*** vermarah_ has joined #openstack-infra16:57
ctraceyit pulls the project at the given ref, consults gerrit for the hard pip dependencies used, and builds *that* into an venv/rpm/deb16:57
ctraceypypi moves too much16:57
ctraceyin my case, I am fetching the build logs and parsing for the pip install...which is less than ideal16:58
*** yfried has joined #openstack-infra16:58
*** dkehnx has quit IRC16:58
*** signed8bit is now known as signed8bit_ZZZzz16:58
ctraceyi guess bottom line is that with the current setup there is no way to get the same bits on a box16:58
*** Guest21331 has quit IRC16:58
fungictracey: yeah, particularly you don't necessarily want to pin to specific pip package versions because they'll have known bugs, security vulnerabilities, et cetera fixed in later versions... which is why we keep testing stable release branches with new dependencies over their lifetime16:58
*** dkehn has joined #openstack-infra16:59
mordredfungi: I still disagree with that, btw16:59
* mordred thinks we should have hard == pins at all times16:59
fungimordred: fair. i didn't say i agreed that it was appropriate, just echoing the common rationale cited ;)16:59
ctraceymordred: yes!16:59
mordredmainly because of how absolutely crappy every single python package is16:59
mordredfungi: :)16:59
*** hogepodge has joined #openstack-infra17:00
ctraceyit wouldnt be much to just echo the pip dependencies out to a file and save that17:00
*** banix has joined #openstack-infra17:00
ctraceyi dont care so much about the logs themselves17:00
*** amuller has quit IRC17:00
fungimordred: essentially, i think stable releases should be the domain of the distros, and they should (collectively) be deciding what's in the global requirements list for our ci on stable branches to most closely match what's being run in the wild17:00
mordredctracey: that would not be particularly difficult to do17:00
*** jlibosva has quit IRC17:00
ctraceymordred: correct...but insanely useful17:01
*** SumitNaiksatam has quit IRC17:01
clarkbmordred how would you raise your pins over time?17:01
ctraceyand...as long as the deprecation timeline is fixed at 2 cycles, we should at least save 12  months of being able to build exactly the same17:01
clarkbI think failing fast is best option there17:02
*** masayukig has quit IRC17:02
sdaguemordred: \\\\\\\\\\\17:02
*** palar has joined #openstack-infra17:02
fungictracey: effectively, right now we've not classed job logs for differing retention cycles, so ideally we'd need a proposal which identified, say, long-term and short-term retention parameters which we could generalize17:02
*** palar has quit IRC17:02
sdagueoops, stupid keyboard17:02
*** maxbit has joined #openstack-infra17:02
*** palar has joined #openstack-infra17:02
*** dims has joined #openstack-infra17:02
sdagueclarkb: honestly, if we wanted to go down that path we'd have a background job that tried the latest versions of things and if they passed, would propose them to requirements17:02
*** dims is now known as Guest2372117:03
*** kgriffs is now known as kgriffs|afk17:03
*** zns has joined #openstack-infra17:03
*** lttrl has joined #openstack-infra17:03
fungisdague: though the pip pinning discussion comes back around to the challenges i encountered the last time i tried to implement it...17:03
*** ihrachyshka has quit IRC17:03
*** gokrokve has quit IRC17:03
*** otherwiseguy has quit IRC17:03
ctraceyim not talking about pinning...im talking just tell me what was used...pinned or not17:04
fungisdague: in particular, we have to identify second+ order dependencies and declare/pin those too, and they also potentially differ between interpreter versions17:04
*** gokrokve has joined #openstack-infra17:04
sdaguefungi: sure17:04
sdaguebut richard has some of those tools now17:04
mordredclarkb: you'd raise your pins over time the same way as now17:04
mordredyeah - what sdague said17:04
fungisdague: yep, so possibly easier than when i last attempted it17:04
sdaguectracey: we have a pip-freeze captured during the run17:04
ctraceysdague: but useless when the logs disappear is my point17:05
sdaguectracey: sure17:05
sdagueok, I must have missed something17:05
*** derekh_ has quit IRC17:05
*** flaper87|afk is now known as flaper8717:05
fungictracey: yeah, so basically the way our current expiration mechanism works is by file name pattern. picking specific globs to retain for longer wouldn't be too hard... however all this changes with object storage (have we worked out our retention/expiration mechanisms for that yet?)17:06
sdaguectracey: why do you need long old build logs?17:06
mordredfungi: I think we're going to assume that we can retain for forever17:06
ctraceysdague: im just gauging whether we would feel comfortable with instead of "pip freeze > <log>" do "pip freeze > pip.deps.log"17:06
*** zns_ has quit IRC17:07
fungisdague: ctracey wants a pip freeze from a particular job on a particular commit which was proposed to master in the havana timeframe to be able to recreate the build environment under which it ran17:07
ctraceysdague: because without it we cant rebuild something that is still out there17:07
jeblairmordred: i don't think we can assume we'll retain forever17:07
sdaguefungi: vs. stable havana current runs?17:07
ctraceysdague: correct17:07
fungisdague: apparently17:07
ctraceyhere is the use case...17:07
ctraceyi have a stable/havana build from October17:08
mordredjeblair: sorry, that was more tongue in cheerk ...17:08
*** otherwiseguy has joined #openstack-infra17:08
ctraceyupgrade 2 weeks ago and broken17:08
*** signed8bit_ZZZzz is now known as signed8bit17:08
*** masayukig has joined #openstack-infra17:08
fungictracey: you're installing from source+pip packages?17:09
clarkbpinning is just a headache. take six for example17:09
jeblairmordred: oh, cloud. lol.  :)17:09
fungictracey: in theory your pip.log should tell you what upgraded from what to what... unless i'm misremembering how much detail it logs17:10
*** amcrn has joined #openstack-infra17:10
sdagueI don't think it's unreasonable to want to keep the logs for the history of all the supported releases if we could. At least for the "golden path" jobs17:10
*** shashankhegde has joined #openstack-infra17:11
ctraceyfungi: this particular use case is horizon from source, yes17:11
fungisdague: agreed. i think we just need a proposal of what to keep for how long and what else to keep for how much longer and make sure it's implementable with our archive cleanup automation17:12
sdaguefungi: sure17:12
ctraceyi will double check the pip logs...but I think the point still stands that we should always be able to rebuild 2 releases back...that is just my opinion17:12
fungiwith appropriate compromises where we need to make them if we're constrained on quota17:12
sdaguectracey: if you have a cloud to give us 30 TB of filesystem attached to a guest, it would help :)17:13
fungictracey: i'm not sure what "rebuild" means in this case. we basically release source tarballs, not "builds" (modulo some packaging-time-generated metadata)17:13
ctraceyand, fwiw, that is the whole point of my tool dubbed "giftwrap"...so that you dont end up in the particular mess and pull dependencies on your own (tested) clock17:13
ctraceyfor large SPs and integrators, distro packages just dont cut it17:14
ctraceysdague: please dont misunderstand ....im not hating here :)17:14
*** BobBall is now known as BobBallAway17:14
ctraceyi agree the logs are basically useless...just the deps are super helpful17:14
*** hashar has joined #openstack-infra17:15
*** julim has quit IRC17:15
mordredthus the reason I think we should have complete pinned requirements lists17:15
ctraceymordred: ++17:15
*** SumitNaiksatam has joined #openstack-infra17:15
clarkbmordred doing so will break on eg six without atomic commits across projects17:16
fungictracey: one thing which could probably help would be a change history of what was on pypi at specific points in time which matched the version specs in our global requirements list17:16
fungiper branch17:16
*** julim has joined #openstack-infra17:16
ctraceycorrect17:16
ctraceythat is helpful as well17:16
sdagueclarkb: will it? Global req will say 'f-u' to the project specific bits17:16
*** otherwiseguy has quit IRC17:16
*** julim has quit IRC17:17
sdaguethat still gives us the global lever17:17
sdagueas long as we ensure they are synchronized before release we're going17:17
ctraceybut a pip freeze to a file would guarantee what you built with17:17
*** rcarrill` has joined #openstack-infra17:17
sdaguethough I guess that doesn't help the CD folks17:17
fungictracey: then that could be matched up to our openstack/openstack metaproject which tracks the sequence of all commits in integrated server projects17:17
clarkbsdague: it did in the past17:17
ctraceyfungi: yes17:17
clarkbwith g-r17:17
ctraceythis is the whole point of giftwrap17:17
*** jpich has quit IRC17:18
ctraceywe need system packages with no moving parts17:18
sdagueclarkb: that was a mirror artifact right?17:18
fungictracey: again, we don't really "build" with anything. it would hopefully tell you what versions we tested against at a specific point in time, but that also may not be super interesting without also knowing what tests we ran and what they exercised17:18
ctraceyand currently that is extremely hard to so17:18
ctraceydo*17:18
clarkbno it was anartifact of using forward compat bits17:18
clarkbyou cant pin forward compat17:18
ctraceyfungi: yes I am overloading "build" here (though they are called "Builds" in gerrid :) )17:19
*** rcarrillocruz has quit IRC17:19
*** zns has quit IRC17:19
ctraceybut the point is that you are testing the code...and presumably the developer that submitted the change tested it17:19
ctraceythere is some assurance that what you built with works17:20
*** zns has joined #openstack-infra17:20
fungictracey: it sounds more like what you want to know is not test log related, but rather "if i installed openstack from a particular branch source+pip under a given interpreter version on date x, what versions of dependencies would have been pulled in at that time?"17:20
ctraceyyes17:20
ctraceyprecisely17:20
ctraceyhere is another example from a while back...17:20
ctraceyhttps://ask.openstack.org/en/question/10214/extensionmanager-object-does-not-support-item-assignment/17:21
mordredwell - you can probably get that to some degree from openstack/openstack17:21
*** ZZelle_ has joined #openstack-infra17:21
mordredctracey: do you know about openstack/openstack ?17:21
ctraceymordred: but there are no pips in there17:21
fungiand you might be able to *infer* that from our testing log data, but we don't specifically do just that without muddying it with other things17:21
ctraceyyes17:21
mordredis the global requirements repo not in there?17:21
fungiand also it would have depended a great deal on what local system-provided dependencies you also happened to have installed from your distro which pip considered to already meet its needs17:21
ctraceywhich would also be a fine place to store that info!17:21
ctracey(and github probably has 30TB) :)17:22
mordredI think that if we had something like the richard "test specific pinned things and write them to global reqs" thing17:22
ctraceyfungi: thats where a virtualenv comes in17:22
mordredthen the fact that openstack/openstack already records the time relationship between projects and history17:22
mordredwould contain pretty much whatever you need on the python layer17:22
ctraceyyes17:22
fungictracey: virtualenv doesn't necessarily help there. are you creating your virtualenv with system site packages enabled?17:23
*** morganfainberg is now known as reallywantscoffe17:23
*** hashar has quit IRC17:23
ctraceyfungi: i want each project to have its own venv17:23
*** reallywantscoffe is now known as morganfainberg17:23
fungictracey: that gets amusing when you consider that a lot of the dependencies install-time link to system libraries outside the venv17:24
fungiand also when some python dependencies are even not pip installable (for example libvirt in the havana timeframe was not)17:24
ctraceyfungi: correct...that is the whole "venvs are not transferrable" thing17:24
ctraceybut can be mitigated pretty easily17:24
*** otherwiseguy has joined #openstack-infra17:25
ctraceyfwiw...only a 0.3.0 but the code is over here: https://github.com/cloudcadre/giftwrap17:25
fungictracey: point being, what we installed while running some tests on a particular date probably doesn't give you enough information to infer what you actually installed on a particular platform on that date17:25
*** maxbit has quit IRC17:26
*** salv-orlando has quit IRC17:26
fungiit might get you a start, but it's a poor proxy for that actual information17:26
ctraceyi agree it doesnt give everything17:26
ctraceybut it puts me in a *much* better spot than we are in now17:27
fungiso while i agree that we might benefit from varying retention periods for some kinds of test data, i think your use case would be better met by other mechanisms17:27
arosenfungi:  i ran into an interesting issue with nodepool. So my vms get booted but nodepool can't ssh into them.  I see my public key is on the host too. Once I update the host's sshd_config file to say  PermitRootLogin Yes it works17:28
ctraceythis is part of reason why "staying close to trunk" is rather difficult...too many moving parts17:28
*** malini1 has joined #openstack-infra17:28
fungictracey: no argument there. we see it first-hand ;)17:29
openstackgerritA change was merged to openstack-infra/config: Adds pip freeze output to pep8 job  https://review.openstack.org/10570117:29
ctraceyyou certainly do...and serious thanks for that!17:29
fungiarosen: hm... i believe we log in after the snapshot boot with a non-root account17:29
fungiarosen: which is part of why we make /etc/nodepool world-writeable17:30
malini1hello..I need some help figuring out if/how we can run the marconi jobs in Trusty17:30
ctraceyi have strong reasons for wanting to break free of distro packaging (as do many many many of the other large scale operators) and I think we should make this (more) possible17:30
fungimalini1: which jobs specifically? unit tests?17:30
ctraceythere was an overwhleming sentiment at the last operators summit in march around this17:30
malini1fungi: yes..we need the newer mongo/redis tht comes with Trusty17:30
*** mestery has quit IRC17:31
fungimalini1: have you tried running them yourself on trusty? it's fairly easy for us to switch the jobs to run on it once you're ready17:31
*** mestery has joined #openstack-infra17:31
*** HenryG_ has joined #openstack-infra17:31
mordredctracey: I am with you on breaking free of distro packaging17:32
fungimordred: this is where you make a pitch for tripleo ;)17:32
malini1fungi: sure..I will confirm that it works in Trusty. Can I just ping you after that?17:32
fungimalini1: yep--feel free17:32
malini1fungi: thanks!17:32
mordredctracey: I think the larger issue is that so far we have not seen the project as a direct source distribution and rather as the source for people who  make such things17:32
mordredctracey: that needs to be sorted, and there are other logistical issues related to that17:32
ctraceymordred: yep. agree.17:33
mordredctracey: so it does get slightly tricky - however, I'm in your camp in general17:33
*** kgriffs|afk is now known as kgriffs17:33
*** james_li has quit IRC17:34
ctraceymordred: the point of giftwrap is that you can do this stuff, but that should you choose to go bespoke you can do that as well17:34
*** HenryG has quit IRC17:34
ctraceymordred: i think if we provide the proper tooling then the foundation is not 'on the hook' as a distributor17:34
arosenfungi:  I see the ssh key is the jenkins account on the node. I think the issue is with the sshd_config file it generates. It has:  Mach host ci-puppetmaster.openstack.org but i think that should be my jenkin server ip17:34
fungithere are definitely quite a few larger openstack member companies, employing a significant percentage of our developer base, who see it as part of their business model to repackage openstack and make it usable. competing with them from within the project leads to rather interesting community dynamics17:35
funginot that i don't think it should be a primary mission of ours as a project, just pointing out the hard truth17:35
mordredI don't mind "competing" if the way I compete is by fixing an organizational bug that they happen to be fixing17:36
mordredI'm not saying we're going to accomplish taht17:36
mordredbut if there is a deficiency in the world and they exist to solve that17:36
mordredand we can make that deficiency go away17:36
mordredI'm not going to not do that just because they're making a business off of fixing a long-standing bug17:36
mordrednow, is that possible or reasonable? maybe not17:36
ctraceyfungi: its not competition. they can feel free to do so.17:36
*** cdub has quit IRC17:37
mordredbut if we avoid doign that then we do wind up being strangly open core17:37
ctraceyin fact we already have anvil which has similar functionality17:37
*** banix has quit IRC17:37
arosenfungi:  I think i need to update /etc/puppet/puppet.conf  server variable. Let me see if that does the trick.17:37
mordredalso, tripleo can produce point-in-time deployment artifacts without even bothering with distro pacakges17:37
mordredso it's not like the problem space isn't being explored :)17:38
ctraceymordred: as can my omnibus-openstack project17:38
mordredyup17:38
fungiarosen: okay, if not, i can point you to some more specific details about our deployment which you can check against17:38
ctraceylots of integrators dont want to be on hook for system dependency management as well17:38
*** salv-orlando has joined #openstack-infra17:38
*** Ryan_Lane has joined #openstack-infra17:38
mordredonce we stray outside of python pacakges though, things get MASSIVELY harder if we don't want to become a de facto linux distro though17:39
*** HenryG_ is now known as HenryG17:39
ctraceymordred: correct!17:39
*** thedodd has quit IRC17:39
fungiwhich is a topic we've waffled back and forth on over time17:39
mordredso far we're trying to balance on the edge of being forward looking but also being installable on existing distros without people needing an openstack project supplied distro-packages repo17:40
mordredthe current libvirt issues show the warts on that17:40
*** dkliban has quit IRC17:40
arosenfungi: Ah i need to delete the image and have it rebuild if i change /etc/puppet on my nodepool box?17:40
*** banix has joined #openstack-infra17:40
ctraceymordred: libvirt is what made me rethink omnibus-openstack...the decision was easy17:41
fungiarosen: yeah, that is one downside is that anything you alter which changes the nature of the snapshot needs an image update. you don't have to delete the image, you can just initiate an image update on demand17:41
clarkbmordred: in fairness that issue is only for people installing test requirements17:41
clarkbwe purposely did that (thank dprince for pointing it out in review)17:42
*** dkehn_ is now known as dkehnx17:42
*** zehicle_at_dell has quit IRC17:42
clarkbmordred and test requirements put you in a special bracket imo17:42
arosenfungi:  nodepool image-update  local_01 d-p-c ?17:42
fungiclarkb: well, or for people who want to, e.g., run nova from source under a virtualenv in production17:42
*** praneshp has joined #openstack-infra17:42
fungiclarkb: i think?17:42
*** kgriffs is now known as kgriffs|afk17:42
clarkbfungi that does not require test requirements17:42
ctraceyfungi: that is the vast majority of large scale operators17:43
fungiarosen: right17:43
ctraceycorrect17:43
mordredclarkb: no. it's not17:43
*** banix has quit IRC17:43
fungiclarkb: does nova not need python bindings for libvirt except when running tests?17:43
mordredclarkb: if you want to run nova for real, nova may want you to run with updated python-libvirt17:43
clarkbmordeed why not? it is for testing potentially broken code17:43
mordredI'm not talking about testing17:43
mordredI'm talking about actually running actual openstack17:43
*** banix has joined #openstack-infra17:43
mordredand openstack being able to tell people that libvirt 0.9.8 is stupid17:44
clarkbfungi you just do what we have done for years17:44
arosenfungi: looks like it failed ? http://paste.openstack.org/show/89425/17:44
mordredthat's potentially an important thing for openstack to be able to say17:44
mordredbecause 0.9.8 MAY be something that's unreasonable17:44
clarkbmordred sure. I am just saying we didnt smack down all deployments of juno17:44
clarkbwe might break a few test beds17:44
fungiclarkb: i mean if someone wants to run nova contained in a virtualenv without system site packages enabled17:44
clarkbI am ok with that but also ok with saying stop using old libvirt17:45
clarkbfungi then they must upgrade17:45
ctraceymordred: correct and if we think that something > 0.9.8 is good we can suggest it with a PPA that is listed in a deb recommends17:45
clarkbmy change had nothing to do with that17:45
arosenfungi:  ah it can't ssh to the host because of this config issue. I think i need to do a delete image and have it rebuild then.17:45
fungiclarkb: yep, just pointing out that the declared use case of isolating openstack component dependencies from one another and from teh system by using virtualenvs mostly depends on newer libvirt17:45
mordredctracey: we _could_ - except what happens the instant we have ppas is that people use them in production17:45
ctraceymordred: this is true :17:46
mordredctracey: and I mean even in the past (3 years ago) when the ppa was literally called "broken-testing-only-do-no-use"17:46
ctracey:)17:46
ctraceyhaha17:46
mordredwe got bug reports that it was broken17:46
*** Sukhdev has joined #openstack-infra17:46
mordredfungi: that's one of the reason I've been playing with docker instead of virtualenv17:47
fungiclarkb: so i was trying to explain why that wasn't actually doable for, in the originally stated case, havana openstack17:47
mordredbecause it could allow us to expand away from just virtualenv without accidentally providing something that looks like a production install17:47
mordredsince you can't actually run iscsi in a container :)17:47
clarkbfungi gotcha17:48
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Create specs.o.o/index.html  https://review.openstack.org/11075617:48
fungimordred: sure. makes sense. also comes with a complimentary handlebar mustache ;)17:48
ctracey"reading is fundamental" :)17:48
jeblairmordred, clarkb, fungi: can one of you look at 106114?  it's stalling some things.17:48
jeblairmordred: i'm pretty sure docker is used in production ;P17:49
fungijeblair: wanting the patch reworked? i can update it real quick17:49
jeblairfungi: er, no... i mean deciding whether the comment is a blocker :)17:50
mordredjeblair: yah - I know ... and righfully so actually17:50
fungijeblair: ahh, seems to me like something we'd fix in a separate change, i agree17:50
mordredjeblair: I'm just saying you actually physically can't run openstack in production in docker17:50
mordredjeblair: because of iscsi17:50
jeblair(i think it's a good suggestion but not a blocker and would love someone not fungi to aprv it; or if it is a blocker, to say so and i'll redo it)17:50
*** cyli has left #openstack-infra17:50
jeblairmordred: details that will deter no one!17:50
fungii will at least leave a comment to that effect17:50
mordredjeblair: :)17:50
*** adalbas has quit IRC17:50
* mordred afks for a sec17:51
clarkbI like the suggestion but am fine with a follow up change17:51
*** ramashri has quit IRC17:52
*** annegent_ has quit IRC17:52
clarkbwill approve17:52
openstackgerritafazekas proposed a change to openstack-infra/devstack-gate: multi-node dg setup  https://review.openstack.org/10604317:52
clarkbdone17:53
jeblairclarkb: 107841 may be of interest to you17:53
fungialso, on a tangentially related note, i have minimal sympathies for people who run code they haven't reviewed under an account which has sudo rights (or access to anything sensitive for that matter). always have a separate sudo-privileged account and only log into it when you need elevated permissions for things17:53
fungiif i tried to run test.sh on my test system, it would complain up and down about sudo not working and would also e-mail me17:54
clarkbjeblair thanks17:54
jeblairclarkb: is 108155 going to work or is it going to get caught up in the default node functions and end up requesting precise?17:55
*** zns has quit IRC17:55
clarkbjeblair it needs a zuul layout update17:56
openstackgerritA change was merged to openstack-infra/config: Make POSTGRES gate job run eventlet keystone  https://review.openstack.org/10646017:56
clarkbpcrews are you around to talk logstash tags?17:56
pcrewsclarkb: aye - what's up17:56
clarkbpcrews the tags are used to know how to parse tge files. eg oslofmt says this file is in oslo log format17:57
clarkbpcrews the files you have added dont seem to have tags that correspond to formats17:57
clarkbpcrews its ok to have what you did byt we need format info too17:58
jesusaurusclarkb: oh is that how youre handling having a bajillion different formats?17:58
clarkbyup17:59
pcrewsah - gotcha, I was not aware of this - I thought it was more for human digging through kibana (/me puts on dunce cap).  *that* makes several things click and I'll see about fixing it.  Should I WIP that review until I get it sorted?17:59
clarkbsure17:59
pcrewsclarkb: many thanks for the info :)18:00
*** lukego has joined #openstack-infra18:00
clarkbsee modules/openstack_project/templates/logstash/indexer.conf.erbfor the logstash side of the config18:00
*** afazekas has quit IRC18:00
*** melwitt has joined #openstack-infra18:01
pcrewsI was going to be poking at that for this bug - https://bugs.launchpad.net/openstack-ci/+bug/1350121 :)  Your info has most likely helped w/ that too.18:03
uvirtbotLaunchpad bug 1350121 in openstack-ci "logstash has empty "%{logmessage}" messages vs. actual content for many files" [Undecided,New]18:03
clarkbhrm I think that may be related to failed multiline parsing18:03
jeblairannegentle: i'm confused by your first comment on the docs-publishing specs.   bouth http://docs.openstack.org/developer/nova/ and http://docs.openstack.org/developer/nova/havana/ exist and have the expected content18:04
jeblairas does http://docs.openstack.org/developer/nova/icehouse/18:04
*** dkliban has joined #openstack-infra18:05
*** homeless has quit IRC18:06
jeblairannegentle: i was trying to illustrate the "overlay doc builds for different versions into one publishing tree" thing that happens with master and other branches18:06
*** Guest23721 has quit IRC18:07
*** dims has joined #openstack-infra18:07
*** dims is now known as Guest1010018:08
*** kgriffs|afk is now known as kgriffs18:08
openstackgerritDavanum Srinivas (dims) proposed a change to openstack-infra/config: Create git repo and jenkins jobs for oslo.serialization  https://review.openstack.org/10886118:10
*** ramashri has joined #openstack-infra18:12
*** kgriffs has left #openstack-infra18:14
*** zns has joined #openstack-infra18:15
bknudsonthis review says starting gate 2 days ago -- https://review.openstack.org/#/c/109820/318:15
*** jerdfelt has joined #openstack-infra18:16
bknudsonI don't see it in zuul status... is there some way to get it back in the queue?18:16
*** james_li has joined #openstack-infra18:16
jeblairbknudson: reapproval, or 'recheck no bug' should do it18:17
*** wilfredo has joined #openstack-infra18:17
*** julim has joined #openstack-infra18:17
bknudsonthat's what I thought, but I wanted to ask first.18:18
jeblairbknudson: i'm trying to track down what happened to it in the logs18:18
jerdfeltso i have a review that got 2 +2s and a +A a week ago but jenkins never started the gate process for it18:18
*** jerryz_ has joined #openstack-infra18:18
jeblairjerdfelt: link?18:19
*** jerryz has quit IRC18:19
jerdfelthttps://review.openstack.org/#/c/109104/18:19
*** jerryz has joined #openstack-infra18:19
jerdfelti think it was because it was dependent on another change when the +A happened. that did get merged but this just stalled out18:20
jeblairjerdfelt: hrm.  it's supposed to pull it in automatically when that happens.  i'll dig into that one too.  in the mean time, reapproval or 'recheck no bug' should kick it18:20
jerdfeltit needs a rebase anyway18:21
jerdfeltjust wanted to let you know since it looks like something broke along the way18:21
jeblairbknudson: ah, that change was kicked out of the queue because a change it depended on failed; the fact that zuul did not report that is a bug that has a fix, but hasn't been deployed18:22
*** arnaud__ has quit IRC18:22
*** jerryz_ has quit IRC18:22
bknudsonjeblair: great, thanks for looking into it18:23
*** yamamoto_ has quit IRC18:24
*** nelsnelson has joined #openstack-infra18:24
*** nelsnelson has quit IRC18:24
*** thedodd has joined #openstack-infra18:24
*** nelsnelson has joined #openstack-infra18:26
wilfredoHello everybody, I am planning to install my first Third-Party CI. Anyone available for basic questions?18:27
vhowardwilfredo: i can try my best18:29
*** mrmartin has joined #openstack-infra18:30
*** amitgandhi has joined #openstack-infra18:30
*** mfer has quit IRC18:31
wilfredovhoward: ok, thanks. My first doubt is if there are different types of CI servers. For instance, I work with Cinder, will be necessary any customizations for it?18:31
amitgandhihi, i am wanting to create a new irc channel for an openstack related project i am working on.  is there any limitations on who can prefix their channel name with openstack- ?18:31
jeblairjerdfelt: got it -- the vote from jenkins on 109104 was too old and did not meet the "freshness" check when zuul tried to pull it in because its parent was enqueued.18:31
jeblairsdague, jhesketh, clarkb, fungi: ^ exciting new way the freshness check behaves unexpectedly18:32
*** doddstack has joined #openstack-infra18:33
*** thedodd has quit IRC18:33
jerdfeltjeblair: cool, glad it looked like it was easy to troubleshoot :)18:33
fungijeblair: ahh, yep. we probably want it to recheck the child change under those circumstances rather than just ignore it18:34
*** mpaolino has joined #openstack-infra18:35
*** mpaolino has quit IRC18:35
vhowardwilfredo: we personally use jenkins18:35
*** flaviof_zzz is now known as flaviof18:36
jeblairfungi: unfortunately, we moved some of those things to pipeline requirements to stop the auto-enquing of dependencies when the reqs weren't met18:37
jeblairfungi: this has succeeded18:37
*** arnaud has joined #openstack-infra18:37
*** arnaud__ has joined #openstack-infra18:37
jeblairfungi: i'm not sure how to get a change with an old vote into the _check_ pipeline when its parent goes into the _gate_ pipeline.18:37
fungijeblair: yeah, it's similar to how it fails to enqueue a child change if there is no jenkins vote present at all (as a result of an outage or other bug)18:38
*** wilfredo has quit IRC18:38
*** wilfredo has joined #openstack-infra18:38
fungiperhaps when a comment on a change triggers a freshness check, we should trigger it for all child changes as well?18:39
fungithough that could also unnecessarily increase the frequency of our automated rechecking18:39
*** cnesa9 has joined #openstack-infra18:42
fungianother option, which adds further complication, but we could have remediation configurable for circumstances under which zuul considers enqueuing a change and then turns it down for a particular reason. that way the callbacks could be arbitrarily defined as "if not enqueued because result too old or no vote at all and change not currently running in check, start check" or whatever18:43
*** cnesa8 has quit IRC18:43
* fungi vaguely handwaves some more18:43
*** salv-orlando has quit IRC18:44
openstackgerritA change was merged to openstack-infra/config: Make 'jenkins-job-builder' repo configurable  https://review.openstack.org/9919018:44
*** shashankhegde has quit IRC18:46
*** homeless has joined #openstack-infra18:46
*** amitgandhi has quit IRC18:46
*** amitgandhi has joined #openstack-infra18:47
*** Ajaeger has joined #openstack-infra18:51
*** shashankhegde has joined #openstack-infra18:52
*** mfer has joined #openstack-infra18:54
openstackgerritA change was merged to openstack-infra/config: Update git refs before comparing refs  https://review.openstack.org/10588818:57
*** pcm_ has joined #openstack-infra18:58
*** mfer has quit IRC18:59
*** marun is now known as marun_afk18:59
*** ramashri_ has joined #openstack-infra19:01
*** ramashri has quit IRC19:01
*** palar_ has joined #openstack-infra19:01
arosenfungi:  doh my setting did do what i thought it would. I think i need to change this to my puppet server right? https://github.com/openstack-infra/config/blob/master/manifests/site.pp#L15319:01
*** wilfredo has quit IRC19:02
*** palar__ has joined #openstack-infra19:03
fungiarosen: probably not... nodepool connects to the template instance via ssh, downloads whatever puppet configuration via git and then locally applies it. that shouldn't touch a puppet master at all...19:03
arosenfungi:  ah sorry. I think i should edit this file: https://github.com/openstack-infra/config/blob/master/modules/ssh/templates/sshd_config.erb#L89 and add an entry for my hosts.19:04
fungiarosen: neither our template instances nor our worker instances communicate with our puppet master19:04
*** arnaud__ has quit IRC19:05
*** arnaud has quit IRC19:05
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Refactoring Trove gates jobs  https://review.openstack.org/10841119:05
*** palar has quit IRC19:05
fungiarosen: i'll let you know what our sshd_confg looks like on our workers in production... hold on19:05
*** banix has quit IRC19:05
arosenfungi:  I'm guessing it looks like this: https://github.com/openstack-infra/config/blob/master/modules/ssh/templates/sshd_config.erb#L8919:06
arosenbut in my setup i need to add a Match host for my nodepool server19:06
*** palar_ has quit IRC19:07
openstackgerritA change was merged to openstack-infra/config: Use review.openstack.org in examples  https://review.openstack.org/10765519:07
fungiarosen: we don't have any entries in our sshd_config allowing root logins from our nodepool server, since it doesn't log into the resulting nodes as root19:07
arosenfungi:  ah sorry you said that before.19:08
arosenHrm19:08
arosenfungi:  let me keep digging then sorry.19:08
fungiarosen: we have a couple entries for ci-puppetmaster.openstack.org and puppetmaster.openstack.org which we don't use... they're just bleed-over from our static hosts where we run puppet agent periodically via ansible19:08
*** sigyn3631 has joined #openstack-infra19:08
*** mrmartin has quit IRC19:09
annegentlejeblair: yeah, my fault, I hadn't realized those were happening, commented on the review itself19:09
fungiarosen: in the providers list within our nodepool.yaml, the images each take a username and private-key parameter. we use "jenkins" as that username and /home/nodepool/.ssh/id_rsa as the private key (whose corresponding public key is puppeted into the ~jenkins/.ssh/authorized_keys on the template during image build)19:10
fungiarosen: then nodepoold connects to the nodes which are booted from the snapshot as the jenkins user with that key19:11
*** changbl has joined #openstack-infra19:13
arosenfungi:  cool, that's my understanding as well how i have things setup.19:13
*** sballe_ has quit IRC19:13
jeblairannegentle: cool, i'll spin another version of that with developer.o.o soon;  I'll probably wait to see if Ajaeger has some thoughts first though.19:14
Ajaegerjeblair: will add comments in the next half hour19:14
jeblairAjaeger: thanks (no rush)19:14
annegentlejeblair: Ajaeger: we are eager today! :)19:15
Ajaegerannegentle: in that case please review https://review.openstack.org/110756 while I look over the blueprint ;)19:17
*** arnaud has joined #openstack-infra19:17
*** arnaud__ has joined #openstack-infra19:17
*** pcm_ has quit IRC19:18
*** flaper87 is now known as flaper87|afk19:18
*** shashankhegde has quit IRC19:20
*** hashar has joined #openstack-infra19:21
*** mmaglana has joined #openstack-infra19:21
*** pcm_ has joined #openstack-infra19:22
*** vermarah_ has quit IRC19:24
openstackgerritA change was merged to openstack-infra/config: Run install_modules.sh in puppet apply test  https://review.openstack.org/10611419:24
fungiSergeyLukjanov: if you're around, what would have made 110807 a +2 for you instead of just +1?19:25
*** banix has joined #openstack-infra19:27
*** bauzas has quit IRC19:27
*** harlowja_away is now known as harlowja19:27
davidlenwelloff topic .. https://www.dropbox.com/s/add3u61mzowi2x6/10424341_10154386604370655_2485395846366779541_n.jpg19:27
*** yamamoto has joined #openstack-infra19:29
*** pcm_ has quit IRC19:29
*** harlowja has quit IRC19:30
*** malini1 has quit IRC19:30
fungithere is no diet coke19:30
openstackgerritA change was merged to openstack-infra/config: Added advise to use dns over hardcoded ip in third_party  https://review.openstack.org/10456519:31
*** f13o has joined #openstack-infra19:31
*** melwitt has quit IRC19:32
*** sigyn3631 has left #openstack-infra19:33
*** melwitt has joined #openstack-infra19:33
*** yamamoto has quit IRC19:34
jeblairand they're all out of borts19:36
Ajaegerannegentle, jeblair I commented.19:36
*** wilfredo has joined #openstack-infra19:37
*** weshay has quit IRC19:37
*** wilfredo has quit IRC19:37
fungihee. bort19:37
Ajaegerannegentle: regarding  https://review.openstack.org/110756  (besides that copy & paste is evil): Please check what's currently in use: http://specs.openstack.org/openstack/ceilometer-specs/, http://specs.openstack.org/openstack/keystone-specs/ etc.19:39
*** jcoufal has quit IRC19:39
Ajaegerannegentle: full details, just go to specs.openstack.org . For Sahara I already sent https://review.openstack.org/11102219:39
Ajaegerannegentle: that's why I used those names - to be consistent. But I'm fine with using "sahara", "keystone" etc19:39
*** e0ne has joined #openstack-infra19:39
*** jcoufal has joined #openstack-infra19:40
*** emagana has quit IRC19:41
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Create specs.o.o/index.html  https://review.openstack.org/11075619:41
*** emagana has joined #openstack-infra19:41
*** koolhead17 has joined #openstack-infra19:42
*** bauzas has joined #openstack-infra19:43
*** palar__ has quit IRC19:45
*** emagana_ has joined #openstack-infra19:45
*** emagana has quit IRC19:45
*** Sukhdev has quit IRC19:46
*** chuckC has quit IRC19:47
*** unicell has quit IRC19:48
*** lukego has quit IRC19:49
*** pcm_ has joined #openstack-infra19:49
*** arnaud has quit IRC19:51
*** dkliban is now known as dkliban_afk19:51
openstackgerritRavi Sankar Penta proposed a change to openstack-infra/config: Enable barbican, marconi and mistral serices in gate-solum-devstack-dsvm and gate-solum-devstack-dsvm-f20 jenkins builder jobs  https://review.openstack.org/11106119:52
*** amitgandhi is now known as amitgandhinz19:52
*** Alexei_987 has quit IRC19:53
*** melwitt has quit IRC19:53
*** melwitt has joined #openstack-infra19:54
*** melwitt has quit IRC19:54
*** melwitt has joined #openstack-infra19:55
*** arnaud__ has quit IRC19:55
*** jaypipes has joined #openstack-infra19:55
*** datsun180b has quit IRC19:55
*** ociuhandu has quit IRC19:55
*** amitgandhinz is now known as amitg19:56
*** aysyd has quit IRC19:56
*** pcm_ has quit IRC19:57
*** melwitt has quit IRC19:57
*** shashankhegde has joined #openstack-infra19:58
*** melwitt has joined #openstack-infra19:58
*** amitg has quit IRC19:58
*** zehicle_at_dell has joined #openstack-infra19:58
*** amitg has joined #openstack-infra19:58
*** e0ne has quit IRC19:58
*** ramashri_ has quit IRC20:01
*** ramashri has joined #openstack-infra20:02
*** zehicle_at_dell has quit IRC20:03
*** sandywalsh has joined #openstack-infra20:05
*** lukego has joined #openstack-infra20:05
*** chuckC has joined #openstack-infra20:08
*** dimtruck is now known as zz_dimtruck20:09
*** sdake has quit IRC20:11
*** sdake has joined #openstack-infra20:11
openstackgerritA change was merged to openstack-infra/config: Add Elizabeth K. Joseph to users manifest  https://review.openstack.org/10845120:12
*** smcginnis has left #openstack-infra20:12
*** sdake has quit IRC20:13
*** zehicle_at_dell has joined #openstack-infra20:13
*** ramashri has quit IRC20:13
*** sdake has joined #openstack-infra20:13
*** sdake has quit IRC20:13
*** sdake has joined #openstack-infra20:13
*** zz_dimtruck is now known as dimtruck20:15
*** e0ne has joined #openstack-infra20:16
*** ihrachyshka has joined #openstack-infra20:16
*** masayukig has quit IRC20:17
*** kgiusti has left #openstack-infra20:19
*** pcm_ has joined #openstack-infra20:19
openstackgerritA change was merged to openstack-infra/config: Add translation jobs for oslo.utils  https://review.openstack.org/10848220:20
*** arnaud has joined #openstack-infra20:20
*** ihrachyshka has quit IRC20:21
*** ihrachyshka has joined #openstack-infra20:21
*** zns has quit IRC20:22
*** masayukig has joined #openstack-infra20:23
*** malini2 has joined #openstack-infra20:25
*** sdake has quit IRC20:26
*** sdake has joined #openstack-infra20:27
*** marun_afk has quit IRC20:27
*** e0ne has quit IRC20:27
*** marun has joined #openstack-infra20:28
*** marun has quit IRC20:28
*** e0ne has joined #openstack-infra20:28
*** emagana_ has quit IRC20:28
*** emagana has joined #openstack-infra20:29
*** jerdfelt has left #openstack-infra20:30
*** SumitNaiksatam has quit IRC20:30
*** zns has joined #openstack-infra20:30
*** jedimike has quit IRC20:31
*** pcm_ has quit IRC20:31
*** emagana has quit IRC20:33
*** elambert has joined #openstack-infra20:34
*** emagana has joined #openstack-infra20:34
*** e0ne has quit IRC20:35
*** ramashri has joined #openstack-infra20:37
*** hashar has quit IRC20:39
*** pcm_ has joined #openstack-infra20:39
*** vermarah has joined #openstack-infra20:40
*** Ajaeger has quit IRC20:42
*** zul has joined #openstack-infra20:43
*** nelsnelson has quit IRC20:46
*** lukego has quit IRC20:46
*** dkliban_afk is now known as dkliban20:48
clarkbwoot I am connected via all the tunnels20:48
*** yamamoto has joined #openstack-infra20:48
fungieven the chunnel?20:48
*** emagana has quit IRC20:48
*** pcm_ has quit IRC20:49
*** emagana has joined #openstack-infra20:49
clarkbwell I am in a buidling that will only give my ipv6 by default20:49
clarkband my irc host doesn't have a AAAA record (it should)20:49
clarkbso I ssh -D'd to node with ipv4 and tunneled out20:49
fungiwacky. mine does ;)20:49
jeblairclarkb: you are in an awesome building!20:49
fungiso does my irc server ;)20:49
clarkbjeblair: gertty works in tsocks just fine (even though it doesn't need to be tunneled because review.o.o has AAAA)20:50
fungiclarkb: also, what sort of building gives you only ipv6? or is it the sort of building that you can't talk about lest it give you ipnothing instead?20:50
clarkbfungi: portland state university's fourth avenue building (where the engineering school lives)20:51
fungihuh. exciting!20:51
fungiteaching the engineering students to live in the future by taking away the past. makes sense20:51
fungithough if you don't experience ipv4, how will you ever truly understand how awful it is? ;)20:52
* clarkb tries to get some work done finally20:52
clarkbsdague: jeblair I was going to look at the d-g patch to make juno to juno grenade for nova baremetal to ironic work20:52
clarkbis there anything else i should look at first?20:53
*** yamamoto has quit IRC20:53
*** emagana has quit IRC20:53
fungijeblair: question-ish about the specs process (perhaps this has already been discussed in other projects)... it looks like we're writing specs and releasing them under a copyright license but providing no copyright statement?20:54
*** gokrokve has quit IRC20:54
*** SumitNaiksatam has joined #openstack-infra20:55
jeblairclarkb: not that i'm aware20:55
jeblairfungi: seems like an oversight20:55
nibalizerjeblair: puppet 320:56
nibalizer?20:56
openstackgerritA change was merged to openstack-infra/config: Create git repo and jenkins jobs for oslo.serialization  https://review.openstack.org/10886120:56
fungijeblair: cool. mind if i propose a copyright placeholder change to template.rst?20:56
openstackgerritA change was merged to openstack-infra/config: Add #openstack-barbican channel to eavesdrop  https://review.openstack.org/10939820:56
jeblairnibalizer: ack20:57
*** nelsnelson has joined #openstack-infra20:57
nibalizerim down to poke it if you are20:57
*** mfer has joined #openstack-infra20:57
*** pcm_ has joined #openstack-infra20:57
* clarkb pushes d-g bugfix first20:57
jeblairfungi: please do; i'm sure we can fix what's landed20:57
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add fingerprint for bug 1350466  https://review.openstack.org/11073720:57
uvirtbotLaunchpad bug 1350466 in nova "deadlock in scheduler expire reservation periodic task" [Undecided,New] https://launchpad.net/bugs/135046620:57
clarkbhrm maybe that isn't a bug20:58
jeblairnibalizer: i need to spin up a new one; i had to delete the old one because it was broken and spamming20:58
jeblairbe just a min20:58
nibalizeroh noes20:58
nibalizerokay20:59
*** emagana has joined #openstack-infra20:59
clarkbis https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/devstack-vm-gate.sh#n248 a bug21:00
clarkbjeblair: sdague fungi ^21:00
clarkbI guess it is just the localrc being set up21:01
jeblairclarkb: i don't think so -- i _think_ it's because in an upgrade you want to start with the same localrc21:01
*** openstackgerrit has quit IRC21:01
clarkbjeblair: ya21:01
jeblairclarkb: however, assuming that's the case, that not having a comment is a bug :)21:01
*** zul has quit IRC21:01
jeblairclarkb: but let's double check with sdague and/or dtroyer and make sure they agree21:02
*** esker has quit IRC21:02
*** openstackgerrit has joined #openstack-infra21:03
clarkbk21:03
*** esker has joined #openstack-infra21:03
openstackgerritJeremy Stanley proposed a change to openstack-infra/infra-specs: Add copyright placeholder to template  https://review.openstack.org/11108521:05
jeblairpuppet is running21:06
nibalizerexcellent21:06
nibalizerpuppet --version says 3ish?21:06
*** dkliban is now known as dkliban_afk21:06
nibalizeri want to say we pinned to 3.421:06
nibalizeralso if we regened the host, will need to copy over the cert/key21:07
*** pcm_ has quit IRC21:07
fungikrotscheck: when you get a moment, would you mind adding a copyright claim for yourself or your employer (whichever is appropriate) on openstack-infra/infra-specs:specs/storyboard_subscription_pub_sub.rst ?21:07
*** openstack has joined #openstack-infra21:09
*** yamamoto has joined #openstack-infra21:09
*** pcm_ has joined #openstack-infra21:09
jeblairi think launch-node doesn't have the detailed exit code checks, so that "succeeded" and the host was kept, so we can inspect it21:09
fungijeblair: oh, good point. we need it to get the successful exit codes encoded so it knows those aren't failures just because they're nonzero21:10
fungijeblair: i'm pretty certain right now it just checks for !=021:11
clarkbdoes anyone remember where sdague's crazy introspection of env vars with construction of new vars ended up? I think I need to use that21:11
openstackgerritSteve Baker proposed a change to openstack-infra/config: Define *-heat-dsvm-functional job  https://review.openstack.org/11108721:11
* clarkb looks in functions.sj21:11
anteayaadalbas: if you are posting a blog post on your blog, you (like everyone else) can post anything you wish21:11
*** cnesa9 has quit IRC21:12
anteayaadalbas: if you would like to fact check something, you are welcome to put it in an etherpad and ask anyone their opinion to ensure your facts are correct, but that again is your choice21:12
*** pcm_ has quit IRC21:13
*** amitg has quit IRC21:13
openstackgerritElizabeth K. Joseph proposed a change to openstack-infra/config: Update IRC documentation to mention logging  https://review.openstack.org/10907821:14
*** pcm_ has joined #openstack-infra21:14
jeblairfungi, nibalizer: so it looks like we need libxml dev installed in order to install python-cinderclient from pip21:14
*** jp_at_hp has quit IRC21:14
*** marun has joined #openstack-infra21:14
fungijeblair: probably easier to do what i just proposed to the zuul module and install the distro python-lxml package21:14
*** marun has quit IRC21:14
jeblairfungi: yep21:14
openstackgerritElizabeth K. Joseph proposed a change to openstack-infra/config: Update IRC documentation to mention logging  https://review.openstack.org/10907821:15
fungijeblair: that way pip doesn't pull it in and try to install-time compile bindings via libxml2-dev and lbxslt1-dev21:15
jeblairnibalizer: did that happen when you ran this locally?21:15
fungijeblair: and the python-lxml package on precise is new enough to satisfy the current global-requirements.txt so should work out just fime21:15
fungifine21:15
nibalizerjeblair: im not entirely sure what i'm looking at21:15
jeblairalso, any idea about the puppetdb-terminus problem?21:16
jeblairnibalizer: that's the output from the failed initial puppet run21:16
nibalizerokay21:16
nibalizerwere you running it against localhost or against the 2.7 master?21:16
*** marun has joined #openstack-infra21:17
jeblairthe 2.7 master21:17
*** marun has quit IRC21:17
openstackgerritElizabeth K. Joseph proposed a change to openstack-infra/config: Update IRC documentation to mention logging  https://review.openstack.org/10907821:17
nibalizerokay21:17
pleia2yeesh, that was rougher than it should have been21:17
pleia2time for a nap I think :)21:18
jeblairpleia2: sleep well!21:18
pleia2thanks21:18
*** marun has joined #openstack-infra21:18
*** marun has quit IRC21:19
* nibalizer spins up some vms to poke 21:19
*** marun has joined #openstack-infra21:19
nibalizerjeblair: i didn't test running the 3 master against the 2.7 master21:19
*** marun has quit IRC21:19
jeblairnibalizer: do you think these errors are related to that?21:20
*** bauzas has quit IRC21:20
*** daya_k has joined #openstack-infra21:20
jeblairnibalizer: let's assume the pip thing is solved...21:20
*** koolhead17 has quit IRC21:20
jeblairnibalizer: that leaves the puppetdb-terminus error21:20
*** yamamoto has quit IRC21:22
*** bhuvan has joined #openstack-infra21:23
nibalizerthat looks like a pinning issue to me21:23
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Add python-lxml to puppetmaster  https://review.openstack.org/11109121:24
openstackgerritMichael Krotscheck proposed a change to openstack-infra/infra-specs: StoryBoard Streaming API specification  https://review.openstack.org/10525221:24
krotscheckfungi: That what you’re looking for? https://review.openstack.org/#/c/105252/3..4/specs/storyboard_automated_pub_sub.rst21:24
*** doddstack has quit IRC21:25
openstackgerritSpencer Krum proposed a change to openstack-infra/config: Pinning puppetdb-terminus with other puppet packages  https://review.openstack.org/11109221:25
*** doddstack has joined #openstack-infra21:26
openstackgerritMichael Krotscheck proposed a change to openstack-infra/infra-specs: Added copyright header to spec  https://review.openstack.org/11109321:26
fungikrotscheck: lgtm. would be good to check how it renders (i've proposed a similar placeholder for the template in 111085)21:27
*** Shrews has quit IRC21:28
*** signed8bit has quit IRC21:28
fungikrotscheck: it simply dawned on me that we'd forgotten to recommend people document copyright holders for these documents, which is fairly unlike us ;)21:29
nibalizerjeblair:  i've never seen the 'failed to call search' erros21:30
nibalizerbut i think this should fix the pinning problem on puppetdb-terminus21:30
nibalizerhttps://review.openstack.org/11109221:30
jeblairnibalizer: i think install_puppet needs the same change21:32
*** banix has quit IRC21:32
openstackgerritClark Boylan proposed a change to openstack-infra/devstack-gate: Allow for grenade upgrades within a release  https://review.openstack.org/11109421:33
clarkbjeblair: sdague adam_g ^ that is a first stab at this21:33
adam_gclarkb, cool. was gonna start poking at that this afternoon/tomorrow21:34
*** doddstack has quit IRC21:34
clarkbadam_g: one thing I noticed is that for the ironic dsvm jobs we don't set the virt driver to ironic. this means a few localrc settings are not set21:34
*** hogepodge has quit IRC21:34
*** signed8bit has joined #openstack-infra21:34
clarkbadam_g: specifically the stuff at https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/devstack-vm-gate.sh#n11821:34
nibalizerjeblair: sounds right21:34
nibalizerthis is the problem you were talking about re: two places21:34
adam_gclarkb, , yeah. virt driver gets set for the dsvm-virtual-ironic-nv job21:35
clarkbadam_g: oh, so there is a different job that sets that?21:35
adam_gclarkb, yeah. i'm working on getting the full tempest smoke run to pass against VIRT_DRIVER=ironic21:35
clarkbcool21:36
*** andreykurilin has joined #openstack-infra21:36
adam_gclarkb, once thats done we can get rid of the redundancy21:36
clarkbadam_g: so my sideways grenade may need to special case virt driver too21:36
clarkbadam_g: to be "libvirt" on old and possibly "ironic" on new21:36
openstackgerritSpencer Krum proposed a change to openstack-infra/config: Pinning puppetdb-terminus with other puppet packages  https://review.openstack.org/11109221:37
adam_gclarkb, i thought we decided the base/old would be fake virt?21:37
jeblairfungi: can you take a look at https://review.openstack.org/#/c/111091/ and https://review.openstack.org/#/c/111092/ ?21:38
clarkbadam_g: oh right21:39
clarkbadam_g: so this needs work but the initial stab is above :)21:39
james_liHi All, please take a look at   https://review.openstack.org/#/c/111061/21:40
*** andreaf_ has quit IRC21:41
fungijeblair: both lgtm. as for launch/sshclient.py, looks like we might need an extra toggle (or expand the meaning of error_ok)21:42
*** emagana has quit IRC21:42
*** emagana has joined #openstack-infra21:42
*** amitg has joined #openstack-infra21:43
*** andreaf_ has joined #openstack-infra21:43
clarkbthe amount of the internet that does not AAAA makes me sad21:43
fungiif error_ok='puppet' and ret not in [0, 12, 34, 56]:21:43
nibalizerclarkb: is currently ipv6 only21:43
clarkbgandi.net? no ipv6 http21:43
fungiclarkb:  but! but! didn't they see there was a world ipv6 day?!?21:44
*** harlowja_at_home has joined #openstack-infra21:44
jeblairthey have also been slow on dnssec :(21:45
jeblairi blame their US expansion21:45
*** emagana has quit IRC21:46
*** Guest10100 has quit IRC21:47
nibalizerjeblair: haha yesss, dnssec all the things!21:47
*** dims has joined #openstack-infra21:48
*** dims is now known as Guest5014521:48
openstackgerritA change was merged to openstack-infra/config: remove recheck 'no bug' & 'bug #'  https://review.openstack.org/10872421:48
*** thedodd has joined #openstack-infra21:49
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Formalized Resource Criteria API  https://review.openstack.org/11016021:50
*** emagana has joined #openstack-infra21:50
openstackgerritAmit Gandhi proposed a change to openstack-infra/config: Adds Poppy CDN Project  https://review.openstack.org/11109521:52
*** Guest50145 has quit IRC21:52
*** mdenny has quit IRC21:53
*** andreaf_ has quit IRC21:53
*** mestery has quit IRC21:53
openstackgerritClark Boylan proposed a change to openstack-infra/devstack-gate: Allow for grenade upgrades within a release  https://review.openstack.org/11109421:53
clarkbadam_g: ^ something like that21:54
*** mestery has joined #openstack-infra21:54
*** signed8bit has quit IRC21:55
fungisince we merged 108724, should we also go ahead and make recheck and reverify officially synonymous in the config? the limited situations under which reverify works and the fact that they have the same effective outcome just makes for additional confusion any more, i think21:56
jeblairfungi: i think that'd be okay21:56
fungibecause if so, we probably want to do that before we announce the changes21:57
*** nelsnelson has quit IRC21:57
*** dmsimard is now known as dmsimard_away21:58
*** yamamoto has joined #openstack-infra21:59
*** rfolco has quit IRC22:00
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Make recheck and reverify synonymous  https://review.openstack.org/11109822:01
fungiproposed22:01
fungiand the notice to the developer community can perhaps just mention that recheck is preferred and that we may eventually remove reverify to further simplify configuration22:02
jeblairfungi: ++  sdague ^22:03
fungioh, for consistency i should also do layout-dev.yaml22:03
fungidoesn't seem we had any docs in the config repo about reverify though22:03
*** yamamoto has quit IRC22:03
*** otherwiseguy has quit IRC22:04
*** dustins has quit IRC22:04
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Make recheck and reverify synonymous  https://review.openstack.org/11109822:05
*** emagana has quit IRC22:06
*** emagana has joined #openstack-infra22:07
fungior we could even keep reverify around but have it mean "only rerun upstream ci jobs" while recheck is also interpreted by third-party ci. no idea whether that's a helpful distinction or not22:07
*** gokrokve has joined #openstack-infra22:07
*** hogepodge has joined #openstack-infra22:09
*** otherwiseguy has joined #openstack-infra22:09
mattoliverauMorning22:10
*** harlowja_at_home has quit IRC22:10
*** esker has joined #openstack-infra22:10
*** emagana_ has joined #openstack-infra22:10
*** signed8bit has joined #openstack-infra22:10
*** emagana has quit IRC22:10
*** amitg has quit IRC22:11
*** amitg has joined #openstack-infra22:12
*** ihrachyshka has quit IRC22:12
*** jgrimm has quit IRC22:13
*** andreykurilin has quit IRC22:14
*** mfer has quit IRC22:15
*** esker has quit IRC22:15
eharneyi got an email from this patch: https://review.openstack.org/#/c/95535/  with subject "Change in openstack/cinder[master]: #ellipsis(63, $change.subject)"22:16
*** Guest31978 has quit IRC22:16
*** amitg has quit IRC22:16
eharneyseems strange22:16
fungiwow, nice22:16
*** chianingwang has joined #openstack-infra22:17
anteayamattoliverau: morning22:17
fungieharney: i don't see anything unusual in the commit subject for any of the patchsets on that change22:18
*** f13o has quit IRC22:18
eharneyfungi: no, all the other emails and the webui look fine22:18
*** harlowja_at_home has joined #openstack-infra22:18
eharneyfungi: it was from the Jenkins Verified-1 message, and the "Change subject" inside the mail looks fine22:19
clarkbok I have AAAA record now22:19
*** shashankhegde has quit IRC22:19
fungieharney: i'll double-check the gerrit error log haystack for any signs of that needle22:20
eharneyfungi: hopefully git commit messages containing "unicode()" aren't dangerous ;)22:20
*** shashankhegde has joined #openstack-infra22:21
fungieharney: hopefully git commit messages containing actual unicode aren't dangerous either22:21
*** armax has joined #openstack-infra22:22
*** shashankhegde has quit IRC22:22
*** mestery has quit IRC22:22
openstackgerritKurt Taylor proposed a change to openstack-infra/config: Fix formatting and indentation problems in third_party.rst  https://review.openstack.org/11110222:23
*** mestery has joined #openstack-infra22:23
*** pcm_ has quit IRC22:25
*** chianingwang has quit IRC22:26
*** annegent_ has joined #openstack-infra22:27
fungijust noticed that for some reason none of the github repos in stackforge-attic had the gerrit team in their collaborator lists (spotted because gerrit was spamming its logs about being unable to replicate there)22:29
fungifixed now22:29
morganfainbergannegentle, do we have a published minimum mysql version for OpenStack?22:29
fungii suspect when we did the rename they hit the same partial project creation issue we've seen with github in the past22:30
*** signed8bit has quit IRC22:30
adam_gclarkb, hmm. so looking closer at grenade, im not sure how the 'upgrade' from fake -> ironic is going to work. ironic depends on a bunch of host-level setup that is not going to happen if the base install is run with VIRT_DRIVER=fake. (packages, bridges, VMs, etc) im not sure grenade is really designed for migrating between compute drivers ATM22:31
*** annegent_ has quit IRC22:31
fungioh, and the jenkins05 migration went smoothly this morning. took out of service for teh duration, but they ended up being able to do a basically hitless live migration so no observed adverse impact22:31
*** eharney has quit IRC22:32
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Adding Subscription Resource Hook  https://review.openstack.org/10284222:33
adam_gclarkb, i could certainly see how that would be a valuable thing for grenade to do, though, IIRC someone said a we need to do similar testing for nova-net -> neutron22:33
*** stevemar2 has joined #openstack-infra22:34
fungiphschwartz: your magic error node deletion juice can't come soon enough. less than 24 hours and we're already back up to 54 nodes stuck in error+deleting in dfw22:36
fungier, 6422:36
*** stevemar has quit IRC22:36
fungisurprisingly, none in iad and only 3 in ord22:37
*** mfer has joined #openstack-infra22:38
funginot that hpcloud's much better in that regard... we have 24 stuck in error+deleting in hpcloud region b22:38
*** jcoufal has quit IRC22:39
*** jcoufal has joined #openstack-infra22:40
*** mikal_ is now known as mikal22:40
*** esker has joined #openstack-infra22:40
openstackgerritA change was merged to openstack-infra/config: Pinning puppetdb-terminus with other puppet packages  https://review.openstack.org/11109222:44
*** HenryG has quit IRC22:45
*** esker has quit IRC22:45
*** palar has joined #openstack-infra22:46
*** shashankhegde has joined #openstack-infra22:48
openstackgerritA change was merged to openstack-infra/config: Zuul depends indirectly on lxml  https://review.openstack.org/11080722:51
*** dimtruck is now known as zz_dimtruck22:53
*** emagana_ has quit IRC22:55
*** emagana has joined #openstack-infra22:56
*** cnesa has quit IRC22:57
*** ociuhandu has joined #openstack-infra22:57
*** bknudson has quit IRC22:58
*** yamamoto has joined #openstack-infra22:59
*** pdmars_ has quit IRC22:59
*** emagana has quit IRC23:00
*** dangers is now known as dangers_away23:00
*** annegent_ has joined #openstack-infra23:03
*** emagana has joined #openstack-infra23:03
*** yamamoto has quit IRC23:03
*** jcoufal has quit IRC23:05
*** ZZelle_ has quit IRC23:05
*** gnuoy has quit IRC23:05
*** jamespage has quit IRC23:05
*** jamespage has joined #openstack-infra23:06
*** jamespage has joined #openstack-infra23:06
*** annegent_ has quit IRC23:06
*** gnuoy has joined #openstack-infra23:06
*** alexandra has joined #openstack-infra23:07
*** annegen__ has joined #openstack-infra23:07
*** alexandra is now known as asettle23:09
*** esker has joined #openstack-infra23:11
*** samy_ has quit IRC23:11
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Adding Subscription Resource Hook  https://review.openstack.org/10284223:11
*** prad has quit IRC23:12
*** esker has quit IRC23:15
*** cdub has joined #openstack-infra23:16
*** salv-orlando has joined #openstack-infra23:17
*** melwitt has quit IRC23:18
*** bknudson has joined #openstack-infra23:18
*** marcoemorais has quit IRC23:18
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Adding Subscription Resource Hook  https://review.openstack.org/10284223:18
*** shashankhegde has quit IRC23:20
*** dkliban_afk has quit IRC23:20
*** bknudson has quit IRC23:22
*** marcoemorais has joined #openstack-infra23:22
*** emagana has quit IRC23:23
ianwfungi: did you do anything, or was i just trying before everything updated for https://review.openstack.org/#/c/110516/  ?23:23
fungiianw: i replied to your ml post23:23
*** emagana has joined #openstack-infra23:23
fungia couple times23:23
fungiand then pinged you in here while you were fast asleep23:24
fungiall good now23:24
fungiyou weren't crazy, our zuul config was effectively broken23:24
ianwfungi: bah, ok, helps if i run kinit before offlineimap, sorry :)  will read now23:24
*** ociuhandu has quit IRC23:25
fungiyou're in au, right?23:25
openstackgerritmelanie witt proposed a change to openstack-infra/elastic-recheck: add query for IdentityError in test_rescope_token  https://review.openstack.org/11111523:25
* fungi tries to keep track of everyone's sleep patterns23:25
jheskethMorning23:25
ianwfungi: yep.  usually i'm around fairly early .au time (like 3 hours before now)23:26
*** emagana_ has joined #openstack-infra23:26
*** emagana has quit IRC23:27
fungioh, so you're up with the kookaburras then23:27
*** shashankhegde has joined #openstack-infra23:27
*** jaypipes has quit IRC23:27
ianwfungi: thanks a ton, i wasn't looking in there at all.  TIL :)23:28
* fungi imagines them being alarm clocks the way roosters are23:28
jeblairianw: familiar with k5start?  http://www.eyrie.org/~eagle/software/kstart/k5start.html23:29
* fungi is semi-familiar with k5start (well, moreso k4start) but's it's been a while since i've managed kerberos infrastructure23:30
fungikrenew as well23:31
jeblair("k5start offlineimap" sounds like a winner to me)23:31
fungiindeed. nice and persistent thataway23:32
ianwfungi: do get them in the tree outside the bedroom, they're usually pretty quiet, i'm not sure what sets them off23:32
*** melwitt has joined #openstack-infra23:32
fungilooks like the current test load is thrashing our providers more heavily than usual today23:33
jeblairunreviewed_config_changes -= 4023:34
*** f13o has joined #openstack-infra23:35
jeblairi'm down to 50 unreviewed changes!23:35
jeblair(in config)23:36
openstackgerritA change was merged to openstack-infra/config: Add python-lxml to puppetmaster  https://review.openstack.org/11109123:36
fungioh the insanity23:37
*** james_li has quit IRC23:37
*** bknudson has joined #openstack-infra23:37
*** dims has joined #openstack-infra23:40
*** dims is now known as Guest761523:40
*** tchaypo is now known as tchorizo23:41
*** cdub has quit IRC23:43
*** samy has joined #openstack-infra23:44
*** cdub has joined #openstack-infra23:44
*** samy is now known as Guest6071423:44
*** unicell has joined #openstack-infra23:45
*** gyee has quit IRC23:48
*** yamamoto has joined #openstack-infra23:48
*** palar has quit IRC23:48
*** cdub has quit IRC23:49
*** harlowja_at_home has quit IRC23:50
*** melwitt has quit IRC23:50
*** marcoemorais has quit IRC23:51
*** emagana_ has quit IRC23:53
*** jamielennox|away is now known as jamielennox23:53
*** yamamoto has quit IRC23:53
*** marcoemorais has joined #openstack-infra23:53
*** stevemar2 is now known as stevemar23:55
*** atiwari has quit IRC23:57
*** cdub has joined #openstack-infra23:58
*** f13o has quit IRC23:58
*** alexpilotti has quit IRC23:58
*** harlowja_at_home has joined #openstack-infra23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!