Tuesday, 2016-07-26

*** amotoki has joined #openstack-infra00:00
*** kzaitsev_mb has joined #openstack-infra00:02
osnexusCan anyone help me come to understanding as to why nodepool will not ssh into the nodes it creates on devstack? The CI and devstack are on separate VMs that are both behind firewalls. With a floating ip associated, my devstack can ping the nodes fine, but not for nodepool.00:05
*** furlongm has quit IRC00:05
*** furlongm has joined #openstack-infra00:05
osnexusI assume because nodepool can't see them under the immediate firewall because they are in a network contained by nova00:05
osnexusBut how would I expose this network so that nodepool can see the nodes?00:05
*** amotoki has quit IRC00:06
osnexusDo I have to point it to a different DNS?00:06
*** oomichi has quit IRC00:06
anteayawe don't run any of our tooling behind firewalls00:06
anteayaso we don't have tried and true methods of having them work with firewalls00:06
*** kzaitsev_mb has quit IRC00:07
anteayasome third party operators have experience with firewalls and might have some suggestions00:07
*** signed8bit_Zzz is now known as signed8bit00:08
clarkbyou may also want to double check security groups00:09
clarkband floating IPs are sort of the standard expose things (for better or worse). Ee have found direct attached networks to be more reliable00:10
osnexusMy security rules are good to go. The purpose of the firewall is because it seems tempest spins up its own DHCP and we need to keep it contained otherwise our whole network will go down. Where could I find more info on the direct attached networks clarkb?00:12
*** amotoki has joined #openstack-infra00:12
*** mahatic_ has quit IRC00:12
*** roxanaghe has joined #openstack-infra00:14
*** rfolco has quit IRC00:14
clarkbosnexus: lookup provider networking for neutro00:14
anteayaosnexus: and nodepool needs its own network00:14
clarkband its devstack nit tempest running the dhcp server for the nested instances00:15
anteayaif you run nodepool on a network with anything else it will take over the nodes00:15
clarkbanteaya: it shoukdnt we run our nodepool on rax on a network we dont control and its fine00:16
anteayaoh okay00:16
anteayaI have been recommending folks use a separate network for nodepool every since patrickeast reported it took over all of the network it was on00:17
clarkbI think patrickeast is very mistaken00:17
clarkball nodepool does is talk to opemstack00:18
*** mahatic has joined #openstack-infra00:18
clarkbit is incapable of directly managing anything00:18
*** roxanaghe has quit IRC00:18
anteayaokay00:18
osnexusYa, that's all I've seen nodepool doing, it's devstack that seems to stomp on things out of order00:18
anteayaor perhaps I mis-understood00:18
*** Swami has quit IRC00:20
*** ddieterly has joined #openstack-infra00:22
tchaypo_vacay Fungi: thanks00:27
*** mtanin___ has joined #openstack-infra00:28
*** sdague_ has joined #openstack-infra00:29
*** mtanino has quit IRC00:30
*** Sukhdev has quit IRC00:30
*** amotoki has quit IRC00:30
*** Swami has joined #openstack-infra00:33
*** Sukhdev has joined #openstack-infra00:34
*** adrian_otto has quit IRC00:35
harlowjaanyone made/submitted a slack publisher to jenkins-job-builder?00:36
*** thorst has quit IRC00:36
*** thorst has joined #openstack-infra00:37
*** Apoorva_ has joined #openstack-infra00:37
harlowjanm, guess one exists :-P00:38
*** sdake has joined #openstack-infra00:39
*** Apoorva has quit IRC00:41
*** Swami_ has joined #openstack-infra00:41
mgagneharlowja: I'm not sure if that's what you are looking for: http://docs.openstack.org/infra/jenkins-job-builder/publishers.html#publishers.slack00:41
harlowjayup, thx00:42
*** Apoorva_ has quit IRC00:42
*** yamahata has quit IRC00:43
*** pvaneck has quit IRC00:45
*** Swami has quit IRC00:45
*** ayoung has joined #openstack-infra00:45
*** thorst has quit IRC00:46
*** sdake_ has joined #openstack-infra00:50
*** sdake has quit IRC00:52
harlowjaanother question, where is the openstack bot code located00:53
* harlowja has his own bot in oslo, and openstack bot likes to emit warnings on unknown commands that my other bot handles00:53
*** yamahata has joined #openstack-infra00:53
*** hosanai has joined #openstack-infra00:54
harlowjaand said warnings are annoying :-P00:54
harlowjaor is openstack meetbot?00:55
*** sdake has joined #openstack-infra00:55
*** sdake_ has quit IRC00:55
*** adrian_otto has joined #openstack-infra00:57
*** signed8bit is now known as signed8bit_Zzz01:00
clarkbharlowja: there is no bot just jobs that use the credentials01:00
*** ayoung has quit IRC01:00
harlowjahmmmm01:01
harlowjaany idea how '<openstack>harlowja: Error: "meeting_notes" is not a valid command.' gets output then?01:01
harlowjafor example when sending !meeting_notes to my other bot01:01
*** kzaitsev_mb has joined #openstack-infra01:03
fungiharlowja: clarkb misunderstood. you are right, it's a meetbot fork01:05
harlowjaya, damn supybot01:05
fungithe "openstack" irc bot01:05
harlowjaunsure if its got a way to turn off handling invalid things01:05
harlowjaopenstack u not the only bot in town :-P01:05
fungiharlowja: some of its behaviors (for example bug linking) are handled by plugins (the bug plugin is retrieved from a bzr repo in lp)01:06
harlowjaright01:06
harlowjaerrbot is similar01:06
harlowja(which is what i was using for my oslobot)01:06
fungibut yeah the general !-prefixed commands, perhaps it can silence them01:06
fungiwe'd love, i think, to have all our irc bots reimplemented in errbot (or at least it was the best option last time we looked)01:07
fungibut, you know, "it's just a matter of some coding"01:07
harlowjahow many other bots u need?01:07
fungi!no idea how to make this stop generating useless errors01:07
openstackfungi: Error: "no" is not a valid command.01:07
harlowjahttps://github.com/harlowja/gerritbot2/blob/master/plugins/gerritbot/gerritbot.py01:08
harlowjathere is a gerritbot01:08
harlowjaits config is not the same as the yaml that exists01:08
fungiharlowja: also statusbot (which also does successes)01:08
harlowjahmmm01:08
harlowjameetingbot would be the bigger one01:08
harlowjathe other i think are dinky?01:08
fungiyeah, statusbot would probably be easu01:08
fungieasy01:08
fungimeetbot perhaps less so01:08
harlowjanice thing with errbot is that i can plugin to slack01:08
harlowjaor ...01:08
*** Jeffrey4l has joined #openstack-infra01:09
*** kzaitsev_mb has quit IRC01:09
harlowja(which is where i am running gerritbot internally)01:09
harlowjahttps://github.com/harlowja/gerritbot2#gerritbot-version-2001:09
*** tqtran has quit IRC01:09
fungibut i expect we'd willingly replace gerritbot with an errbot equivalent if it really is. config migration is a reasonably trivial concern01:09
harlowjaits just code, ha01:09
fungican probably do a quick script to translate from old and new config, only need it once01:09
harlowjaya, someone needs to fix one issue in errbot though01:10
fungioh?01:10
harlowjahttps://github.com/errbotio/errbot/issues/80301:10
*** thorst has joined #openstack-infra01:10
openstackgerritXiang Chen proposed openstack/diskimage-builder: Explain the difference between 'DIB_OFFLINE' and 'DIB_DEBIAN_USE_DEBOOTSTRAP_CACHE'  https://review.openstack.org/34593501:10
harlowjau'll get that nice output in that issue if the gerritbot2 irc backend is used01:10
harlowjaprobably a dinky fix01:10
*** amotoki has joined #openstack-infra01:10
harlowjabut https://github.com/harlowja/gerritbot2/blob/master/plugins/gerritbot/gerritbot.py#L264 is the code for all that01:11
harlowjanothing crazy01:11
fungigood to know--thanks01:11
*** thorst has quit IRC01:12
*** EricGonczer_ has joined #openstack-infra01:14
*** clenimar_ has joined #openstack-infra01:14
*** clenimar_ has quit IRC01:15
*** zhurong has joined #openstack-infra01:15
*** osnexus has quit IRC01:15
harlowjaalso out of curiosity, where is the code that zuul knows how to read jjb yamls01:17
harlowjaseeing as i'm messing around with jjb, be interested to see the code that converts stuff --> ansible (?)01:18
*** mtanino has joined #openstack-infra01:18
*** sdague_ has quit IRC01:18
*** rfolco has joined #openstack-infra01:18
*** mtanin___ has quit IRC01:19
clarkboh sorry saw openstack bot first01:19
*** jcoufal has joined #openstack-infra01:23
*** adrian_otto has quit IRC01:27
*** Swami__ has joined #openstack-infra01:27
*** jcoufal_ has joined #openstack-infra01:28
*** tphummel has quit IRC01:29
*** EricGonczer_ has quit IRC01:29
*** Swami_ has quit IRC01:30
*** jcoufal has quit IRC01:31
*** ddieterly has quit IRC01:31
*** gongysh has joined #openstack-infra01:32
*** EricGonczer_ has joined #openstack-infra01:34
*** sarob has joined #openstack-infra01:35
*** ddieterly has joined #openstack-infra01:38
*** yamahata has quit IRC01:38
*** rfolco has quit IRC01:39
*** sarob has quit IRC01:39
*** yanyanhu has joined #openstack-infra01:39
*** rbuzatu has joined #openstack-infra01:40
fungiharlowja: http://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/launcher/ansiblelaunchserver.py#n136301:41
*** piet_ has joined #openstack-infra01:43
*** mtanino has quit IRC01:44
*** rbuzatu has quit IRC01:45
*** hichihara has joined #openstack-infra01:45
*** gongysh has quit IRC01:46
*** gongysh has joined #openstack-infra01:47
*** rlandy has quit IRC01:47
*** sdake has quit IRC01:59
*** piet_ has quit IRC01:59
*** jcoufal_ has quit IRC01:59
*** gildub has quit IRC01:59
*** jcoufal has joined #openstack-infra02:00
*** roxanaghe has joined #openstack-infra02:02
*** julim has joined #openstack-infra02:04
*** edmondsw has quit IRC02:05
*** kzaitsev_mb has joined #openstack-infra02:06
*** roxanaghe has quit IRC02:06
*** thorst has joined #openstack-infra02:07
*** thorst has quit IRC02:07
*** tqtran has joined #openstack-infra02:07
*** thorst has joined #openstack-infra02:07
*** ddieterly has quit IRC02:08
*** rbuzatu_ has joined #openstack-infra02:11
*** rhallisey has quit IRC02:11
*** kzaitsev_mb has quit IRC02:11
*** tqtran has quit IRC02:11
*** thorst has quit IRC02:12
*** rbuzatu__ has joined #openstack-infra02:12
*** rbuzatu_ has quit IRC02:15
*** rbuzatu__ has quit IRC02:16
*** Sukhdev has quit IRC02:24
*** hongbin has joined #openstack-infra02:24
*** cfarquhar has quit IRC02:31
*** jcoufal_ has joined #openstack-infra02:32
*** jistr has quit IRC02:32
*** jcoufal has quit IRC02:33
*** Liuqing has joined #openstack-infra02:33
*** jistr has joined #openstack-infra02:33
*** Swami_ has joined #openstack-infra02:34
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet: fix libraries job bash code  https://review.openstack.org/34709802:38
*** Swami__ has quit IRC02:38
*** jcoufal_ has quit IRC02:38
EmilienMif someone can look at this quick patch ^ thanks02:38
*** Swami has joined #openstack-infra02:41
*** Swami__ has joined #openstack-infra02:41
*** Swami_ has quit IRC02:45
*** Swami has quit IRC02:45
*** Swami_ has joined #openstack-infra02:47
*** csomerville has quit IRC02:49
*** esberglu has quit IRC02:49
*** cody-somerville has joined #openstack-infra02:49
*** Swami__ has quit IRC02:51
*** Swami__ has joined #openstack-infra02:51
*** Liuqing_ has joined #openstack-infra02:52
*** zhurong_ has joined #openstack-infra02:54
*** psilvad has quit IRC02:54
*** zhurong has quit IRC02:55
*** Liuqing has quit IRC02:55
*** signed8bit_Zzz is now known as signed8bit02:55
*** Swami_ has quit IRC02:56
*** mattoliverau has quit IRC02:58
*** coolsvap has joined #openstack-infra03:00
*** signed8bit has quit IRC03:01
*** Jeffrey4l has quit IRC03:01
*** cfarquhar has joined #openstack-infra03:01
*** cfarquhar has quit IRC03:01
*** cfarquhar has joined #openstack-infra03:01
*** shashank_hegde has joined #openstack-infra03:02
*** Jeffrey4l has joined #openstack-infra03:04
*** matt6434 has joined #openstack-infra03:06
*** asettle has joined #openstack-infra03:06
*** kzaitsev_mb has joined #openstack-infra03:07
*** markmcclain has quit IRC03:08
*** markmcclain has joined #openstack-infra03:09
*** shashank_hegde has quit IRC03:09
*** oanson has joined #openstack-infra03:11
*** kzaitsev_mb has quit IRC03:13
*** asettle has quit IRC03:14
*** derekjhyang has joined #openstack-infra03:15
*** oanson has quit IRC03:17
*** shashank_hegde has joined #openstack-infra03:17
*** sflanigan has quit IRC03:21
*** shashank_hegde has quit IRC03:22
*** rfolco has joined #openstack-infra03:23
*** sflanigan has joined #openstack-infra03:24
*** shashank_hegde has joined #openstack-infra03:25
*** matt6434 is now known as mattoliverau03:30
*** sree has joined #openstack-infra03:33
*** EricGonczer_ has quit IRC03:35
openstackgerritMerged openstack-infra/project-config: Reduce ovh-gra1 to 40 nodes  https://review.openstack.org/34707503:37
*** sree has quit IRC03:37
*** shashank_hegde has quit IRC03:39
openstackgerritIsaku Yamahata proposed openstack-infra/project-config: networking-odl: add more jobs  https://review.openstack.org/34704503:41
*** tphummel has joined #openstack-infra03:42
*** shashank_hegde has joined #openstack-infra03:43
*** gongysh has quit IRC03:46
*** Nikolay_St has quit IRC03:46
*** yamahata has joined #openstack-infra03:46
*** hichihara has quit IRC03:46
*** rfolco has quit IRC03:47
*** shashank_hegde has quit IRC03:48
openstackgerritMerged openstack-infra/project-config: Convert python-jobs to run on xenial  https://review.openstack.org/34495903:49
*** roxanaghe has joined #openstack-infra03:50
*** PollyZ has joined #openstack-infra03:51
*** piet_ has joined #openstack-infra03:52
*** roxanaghe has quit IRC03:54
*** rossella_s has quit IRC03:59
*** rossella_s has joined #openstack-infra04:00
*** hongbin has quit IRC04:00
*** links has joined #openstack-infra04:03
*** PollyZ has quit IRC04:05
*** amotoki has quit IRC04:07
*** Swami_ has joined #openstack-infra04:09
*** kzaitsev_mb has joined #openstack-infra04:09
*** Swami__ has quit IRC04:13
*** kzaitsev_mb has quit IRC04:14
*** yanyanhu has quit IRC04:20
*** sc68cal_ has joined #openstack-infra04:20
*** roxanaghe has joined #openstack-infra04:22
*** sc68cal has quit IRC04:23
*** Sukhdev has joined #openstack-infra04:25
*** sree has joined #openstack-infra04:26
*** yamamot__ has joined #openstack-infra04:27
*** Sukhdev has quit IRC04:29
*** sree has quit IRC04:31
*** harlowja_at_home has joined #openstack-infra04:33
*** pcaruana has quit IRC04:34
*** psachin has joined #openstack-infra04:35
*** jtomasek has quit IRC04:39
*** yamamot__ has quit IRC04:40
*** shashank_hegde has joined #openstack-infra04:42
*** piet_ has quit IRC04:43
*** gildub has joined #openstack-infra04:44
*** amotoki has joined #openstack-infra04:46
*** yanyanhu has joined #openstack-infra04:49
*** yamamot__ has joined #openstack-infra04:53
*** yamamot__ has quit IRC04:54
*** abregman has joined #openstack-infra04:54
*** jtomasek has joined #openstack-infra04:58
*** sree_ has joined #openstack-infra04:58
*** sree_ is now known as Guest1252104:59
*** Swami__ has joined #openstack-infra05:00
*** harlowja_at_home has quit IRC05:01
*** Swami_ has quit IRC05:04
*** Daisy_ has joined #openstack-infra05:06
*** kushal has joined #openstack-infra05:09
*** amotoki has quit IRC05:10
*** kzaitsev_mb has joined #openstack-infra05:11
*** roxanaghe has quit IRC05:12
*** salv-orlando has joined #openstack-infra05:14
*** gildub has quit IRC05:14
*** kzaitsev_mb has quit IRC05:16
*** amotoki has joined #openstack-infra05:17
*** Srinu has joined #openstack-infra05:20
SrinuHi05:20
SrinuIn jenkins i have two slave nodes and after the completion of one job it is deleting two nodes rather than one node. did any one face this issue05:22
*** amotoki has quit IRC05:35
*** Daisy_ has quit IRC05:37
*** hrubi has quit IRC05:37
*** Daisy_ has joined #openstack-infra05:37
*** jtomasek has quit IRC05:38
*** hrubi has joined #openstack-infra05:40
*** yamamot__ has joined #openstack-infra05:40
*** Daisy_ has quit IRC05:42
*** salv-orl_ has joined #openstack-infra05:48
*** armax has quit IRC05:48
*** salv-orlando has quit IRC05:49
*** savihou has joined #openstack-infra05:51
*** dimtruck is now known as zz_dimtruck05:52
*** amotoki has joined #openstack-infra05:54
*** r-mibu has quit IRC05:56
*** r-mibu has joined #openstack-infra05:57
*** Liuqing_ has quit IRC05:57
*** Liuqing has joined #openstack-infra05:59
*** Liuqing has quit IRC06:02
*** pgadiya has joined #openstack-infra06:02
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Test api-ref theming with openstackdocstheme  https://review.openstack.org/34544106:03
*** amotoki has quit IRC06:04
*** Liuqing has joined #openstack-infra06:04
*** oanson has joined #openstack-infra06:06
*** salv-orl_ has quit IRC06:07
openstackgerritAndreas Florath proposed openstack/diskimage-builder: Add option to be able to run_functests.sh in parallel  https://review.openstack.org/34506506:08
*** Daisy has joined #openstack-infra06:09
*** gongysh has joined #openstack-infra06:09
*** javeriak has joined #openstack-infra06:11
*** amotoki has joined #openstack-infra06:12
*** kzaitsev_mb has joined #openstack-infra06:12
*** Sukhdev has joined #openstack-infra06:13
*** Daisy_ has joined #openstack-infra06:14
*** Daisy has quit IRC06:15
*** kzaitsev_mb has quit IRC06:18
*** Daisy_ has quit IRC06:18
*** Daisy has joined #openstack-infra06:19
*** woodster_ has quit IRC06:19
*** javeriak has quit IRC06:22
*** javeriak has joined #openstack-infra06:22
*** sandanar has joined #openstack-infra06:24
*** cgalan has joined #openstack-infra06:24
*** gongysh has quit IRC06:24
*** gongysh has joined #openstack-infra06:24
*** Swami__ has quit IRC06:25
*** gildub has joined #openstack-infra06:25
openstackgerritPaul Belanger proposed openstack-infra/project-config: Remove tripleo-test-cloud-rh1 from nodepool  https://review.openstack.org/34713806:25
*** kzaitsev_mb has joined #openstack-infra06:27
*** Ravikiran_K has joined #openstack-infra06:29
openstackgerritPaul Belanger proposed openstack-infra/project-config: Use Debian AFS mirror in debian-jessie nodes  https://review.openstack.org/34714006:30
*** Apsu has joined #openstack-infra06:38
*** tesseract- has joined #openstack-infra06:39
*** Sukhdev has quit IRC06:46
*** andreas_s has joined #openstack-infra06:48
openstackgerritMerged openstack-infra/project-config: puppet: fix libraries job bash code  https://review.openstack.org/34709806:48
*** sarob has joined #openstack-infra06:48
odyssey4mehmm, nice to see that the docs jobs are running on xenial now06:50
yolandagood morning06:50
pabelangeryolanda: o/06:51
odyssey4meunfortunately it's no longer showing the docs-draft for a successful result06:51
pabelangerodyssey4me: ya, patch just merged a few hours ago06:51
odyssey4meSee https://review.openstack.org/346510 for a sample06:51
odyssey4mepabelanger progress!06:51
odyssey4meare all the precise nodes now migrated?06:51
pabelangeryes, we only use precise for 2 infra jobs right now06:51
*** shardy has joined #openstack-infra06:52
pabelangerwe need to keep them until all our control plane has been upgraded to trusty06:52
*** mikelk has joined #openstack-infra06:52
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove unused trusty jobs  https://review.openstack.org/34714706:53
AJaegerclarkb: is this something you like to see ? ^06:53
*** sarob has quit IRC06:53
odyssey4mehaha AJaeger tidying up is always good :)06:53
AJaegerodyssey4me: let me fix the docs-draft...06:54
*** Apsu has quit IRC06:54
odyssey4methanks AJaeger06:54
pabelangerAJaeger: I think we can start to prune ubuntu-trusty jobs if projects don't need them06:55
*** Apsu has joined #openstack-infra06:55
*** Nikolay_St has joined #openstack-infra06:55
*** pcaruana has joined #openstack-infra06:55
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Update docs-draft pattern for xenial  https://review.openstack.org/34715006:56
AJaegeryolanda, pabelanger, odyssey4me ^06:56
AJaegerpabelanger: I think as well, just wanted confirmation by clarkb.06:56
pabelangerAJaeger: agreed, I think clarkb will have the final say06:57
pabelangerAJaeger: +206:57
odyssey4melgtm06:58
*** javeriak has quit IRC06:58
AJaegergreat. Then let me +2A it quickly to avoid further confusion...06:58
*** kzaitsev_mb has quit IRC06:59
*** florianf has joined #openstack-infra07:00
*** florianf has quit IRC07:00
*** atom_ has joined #openstack-infra07:02
odyssey4meis there a way to use tox to execute a script, but for tox not to use a virtualenv?07:03
openstackgerritXiang Chen proposed openstack-infra/project-config: add a keep-proxy element  https://review.openstack.org/34661907:03
odyssey4meie I want it to operate within the system, not in a python virtualenv07:04
*** nmagnezi has joined #openstack-infra07:04
*** nmagnezi has quit IRC07:04
*** nmagnezi has joined #openstack-infra07:05
*** rcernin has joined #openstack-infra07:06
*** javeriak has joined #openstack-infra07:07
*** rbuzatu has joined #openstack-infra07:07
*** asettle has joined #openstack-infra07:08
*** gildub has quit IRC07:09
*** tqtran has joined #openstack-infra07:09
*** florianf has joined #openstack-infra07:09
AJaegerodyssey4me: tox will always use a python virtualenv and install needed pacakges in there.07:10
AJaegerodyssey4me: BUT you can say sitepackages=True in a tox environment and then it will *also* use the system installation.07:11
odyssey4meAJaeger hmm, ok that may work07:11
AJaegerSo, it won't install new packages that are already in the system.07:11
odyssey4meperhaps I could also set the pip binary to be the system one instead using an env var?07:11
odyssey4mebasically I'm trying to use the tox builder to execute in the same way as the script builder07:12
AJaegerodyssey4me: I don't know what you want to do - and have to leave now, so can't help further...07:12
odyssey4methis reduces the number of jobs I have to make use of, giving me a common job to execute and take advantage of across all repositories07:12
*** tqtran has quit IRC07:13
*** asettle has quit IRC07:13
odyssey4meah, thanks anyway AJaeger07:13
odyssey4mehave a good day!07:13
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove unused trusty jobs  https://review.openstack.org/34714707:14
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add openstackci-tripleo-test-cloud-rh2 to ansible-clouds.yaml  https://review.openstack.org/34715807:15
openstackgerritYanyan Hu proposed openstack-infra/project-config: Add integration test job for Senlin  https://review.openstack.org/34716007:24
*** rbuzatu has quit IRC07:25
*** gildub has joined #openstack-infra07:27
*** ifarkas_afk is now known as ifarkas07:28
openstackgerritMerged openstack-infra/project-config: Update docs-draft pattern for xenial  https://review.openstack.org/34715007:30
*** javeriak has quit IRC07:31
*** Daisy has quit IRC07:31
*** Daisy has joined #openstack-infra07:32
*** javeriak has joined #openstack-infra07:34
*** zul has quit IRC07:35
*** Daisy has quit IRC07:35
*** Daisy has joined #openstack-infra07:36
*** acruz has joined #openstack-infra07:37
*** gongysh has quit IRC07:37
*** vincentll has joined #openstack-infra07:37
*** jlanoux has joined #openstack-infra07:39
*** jpich has joined #openstack-infra07:40
*** rbuzatu has joined #openstack-infra07:41
*** tonytan4ever has quit IRC07:44
*** rbuzatu has quit IRC07:48
*** rbuzatu has joined #openstack-infra07:49
*** zul has joined #openstack-infra07:52
*** swat30 has quit IRC07:52
*** swat30 has joined #openstack-infra07:56
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-infra08:00
*** salv-orlando has joined #openstack-infra08:03
*** shashank_hegde has quit IRC08:04
openstackgerritMerged openstack-infra/system-config: Re-enable puppet on review-dev.o.o  https://review.openstack.org/34703608:04
openstackgerritMerged openstack-infra/system-config: Install the Gerrit delete-project plugin on review-dev.o.o  https://review.openstack.org/31940008:06
*** jpich has quit IRC08:07
*** salv-orlando has quit IRC08:07
*** dingyichen has quit IRC08:08
*** dizquierdo has joined #openstack-infra08:09
*** sorantis has joined #openstack-infra08:09
*** sorantis has quit IRC08:09
*** nherciu has joined #openstack-infra08:09
*** mikelk has quit IRC08:09
*** sorantis has joined #openstack-infra08:10
*** mikelk has joined #openstack-infra08:13
*** dingyichen has joined #openstack-infra08:16
openstackgerritMerged openstack-infra/project-config: Implement gate-tripleo-ci-centos-7-undercloud-upgrades-nv  https://review.openstack.org/34698208:17
*** asettle has joined #openstack-infra08:18
*** hashar has joined #openstack-infra08:20
openstackgerritAlexey Ovchinnikov proposed openstack-infra/project-config: [Manila] Add services to minimal-dsvm job  https://review.openstack.org/34718008:21
*** abregman has quit IRC08:23
*** abregman has joined #openstack-infra08:23
openstackgerritMerged openstack-infra/project-config: Fix Monasca Log API tempest gate config  https://review.openstack.org/34670308:24
*** jlanoux has quit IRC08:27
*** jlanoux_ has joined #openstack-infra08:27
*** jpich has joined #openstack-infra08:27
*** derekh has joined #openstack-infra08:29
*** pblaho has quit IRC08:32
*** jtomasek has joined #openstack-infra08:33
*** esikachev has joined #openstack-infra08:33
*** Na3iL has joined #openstack-infra08:33
*** tphummel has quit IRC08:34
*** dingyichen has quit IRC08:35
*** zul has quit IRC08:35
*** pblaho has joined #openstack-infra08:35
*** sandanar_ has joined #openstack-infra08:36
*** sandanar_ has quit IRC08:36
*** sandanar_ has joined #openstack-infra08:36
*** acoles_ is now known as acoles08:38
*** flepied2 is now known as flepied08:38
*** Nikolay_St has quit IRC08:39
*** sandanar has quit IRC08:39
*** e0ne has joined #openstack-infra08:40
*** jimbaker has quit IRC08:44
*** tonytan4ever has joined #openstack-infra08:44
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/zuul: Add initial support for jobs authentication config  https://review.openstack.org/34691408:47
*** tonytan4ever has quit IRC08:49
*** salv-orlando has joined #openstack-infra08:50
openstackgerritAleksey Zvyagintsev proposed openstack-infra/project-config: [murano-apps] add 'gate-murano-apps-linters' job  https://review.openstack.org/34483808:50
*** javeriak has quit IRC08:51
openstackgerritAleksey Zvyagintsev proposed openstack-infra/project-config: [murano-apps] add 'gate-murano-apps-linters' job  https://review.openstack.org/34483808:52
*** Goneri has joined #openstack-infra08:52
rcarrillocruzjhesketh: heya08:53
rcarrillocruzaround?08:53
*** zul has joined #openstack-infra08:53
*** electrofelix has joined #openstack-infra08:55
*** e0ne has quit IRC08:55
*** e0ne has joined #openstack-infra08:56
*** yamahata has quit IRC08:57
*** ljjjustin has quit IRC08:57
openstackgerritLuigi Toscano proposed openstack-infra/project-config: tempest/CLI tests for Sahara require also console-log  https://review.openstack.org/34719708:57
*** amotoki has quit IRC08:57
*** ramishra has quit IRC08:58
*** sorantis has quit IRC08:58
*** amotoki has joined #openstack-infra08:59
*** ramishra has joined #openstack-infra08:59
*** gildub has quit IRC08:59
*** ljjjustin has joined #openstack-infra09:00
*** Guest12521 has quit IRC09:02
*** javeriak has joined #openstack-infra09:02
*** rbuzatu_ has joined #openstack-infra09:02
*** sandanar_ has quit IRC09:03
*** sandanar has joined #openstack-infra09:03
*** rbuzatu has quit IRC09:04
openstackgerrityolanda.robla proposed openstack-infra/tripleo-ci: Add --yes flags to heat stack-delete for liberty  https://review.openstack.org/34720209:07
*** ramishra has quit IRC09:09
*** amotoki has quit IRC09:09
openstackgerrityolanda.robla proposed openstack-infra/tripleo-ci: Add --yes flags to heat stack-delete for liberty  https://review.openstack.org/34720209:10
*** tqtran has joined #openstack-infra09:10
*** ramishra has joined #openstack-infra09:11
*** amotoki has joined #openstack-infra09:11
*** rbuzatu_ has quit IRC09:11
*** sree has joined #openstack-infra09:11
*** rbuzatu has joined #openstack-infra09:12
*** ihrachys has joined #openstack-infra09:12
*** kaisers_ has joined #openstack-infra09:12
*** ihrachys has quit IRC09:13
*** tqtran has quit IRC09:15
*** geguileo has joined #openstack-infra09:15
*** sree has quit IRC09:16
*** maniram477 has joined #openstack-infra09:18
*** sarob has joined #openstack-infra09:19
*** maniram477 has quit IRC09:19
*** salv-orlando has quit IRC09:21
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Enable Ceph in OVB/HA2  https://review.openstack.org/34689709:23
*** sarob has quit IRC09:23
sulohi there folks, now that 344959 has merged, can someone look at https://review.openstack.org/#/c/345453/ please :)09:24
openstackgerrityolanda.robla proposed openstack-infra/tripleo-ci: Add --yes flags to heat stack-delete for liberty  https://review.openstack.org/34720209:26
openstackgerritZhijiang Hu proposed openstack-infra/irc-meetings: Add Meeting Information for New Project daisycloud-core  https://review.openstack.org/34653409:26
*** e0ne has quit IRC09:26
*** sorantis has joined #openstack-infra09:29
*** gouthamr_ has quit IRC09:29
*** ihrachys has joined #openstack-infra09:29
*** swat30 has quit IRC09:30
*** Nikolay_St has joined #openstack-infra09:32
*** swat30 has joined #openstack-infra09:32
*** e0ne has joined #openstack-infra09:34
*** nherciu has quit IRC09:34
*** salv-orlando has joined #openstack-infra09:36
zigoAJaeger: Hi! Could you review this one? https://review.openstack.org/#/c/307742/09:39
zigoAJaeger: It should be in a good enough shape. If it is, then we have a working system for building, and I can add the real stuff.09:40
*** sandanar_ has joined #openstack-infra09:40
*** ociuhandu has quit IRC09:41
*** sandanar has quit IRC09:43
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/zuul: Add initial support for jobs authentication config  https://review.openstack.org/34691409:46
*** fbo has joined #openstack-infra09:46
*** fbo has quit IRC09:47
*** sree has joined #openstack-infra09:47
*** xarses_ has joined #openstack-infra09:48
*** fbo has joined #openstack-infra09:48
*** xarses_ has quit IRC09:48
*** xarses_ has joined #openstack-infra09:49
*** hwcomcn has joined #openstack-infra09:49
*** xarses_ has quit IRC09:49
*** xarses_ has joined #openstack-infra09:50
*** xarses has quit IRC09:50
openstackgerritValeriy Ponomaryov proposed openstack-infra/project-config: [Manila] Move dummy driver job to check pipeline  https://review.openstack.org/34722309:51
*** sree has quit IRC09:51
*** hwcomcn has quit IRC09:52
*** sandanar__ has joined #openstack-infra09:52
*** hwcomcn has joined #openstack-infra09:53
*** lennyb has quit IRC09:54
*** sandanar_ has quit IRC09:55
*** pkarikh has joined #openstack-infra09:58
*** ociuhandu has joined #openstack-infra10:00
*** Daisy has quit IRC10:00
*** rbuzatu has quit IRC10:02
rcarrillocruzcorvus , jhesketh : ^ added tests to the jobs auth stuff on zuul v310:03
*** Daisy has joined #openstack-infra10:04
*** rbuzatu has joined #openstack-infra10:06
*** zhurong_ has quit IRC10:06
*** Liuqing has quit IRC10:07
*** Daisy has quit IRC10:08
*** rbuzatu has quit IRC10:10
*** john-davidge has joined #openstack-infra10:11
*** john-dav_ has joined #openstack-infra10:12
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Remove sahara and cinder packaged symlinks in postci  https://review.openstack.org/34722810:13
*** Goneri has quit IRC10:13
*** hrubi has quit IRC10:15
*** john-davidge has quit IRC10:16
*** rbuzatu has joined #openstack-infra10:16
*** javeriak has quit IRC10:17
*** hrubi has joined #openstack-infra10:18
*** _degorenko|afk is now known as degorenko10:18
*** rbuzatu has quit IRC10:20
*** Goneri has joined #openstack-infra10:23
*** yanyanhu has quit IRC10:23
*** amotoki has quit IRC10:24
*** rbuzatu has joined #openstack-infra10:25
*** amotoki has joined #openstack-infra10:25
*** rbuzatu has quit IRC10:25
*** rbuzatu has joined #openstack-infra10:25
*** john-dav_ is now known as john-davidge10:27
*** zul has quit IRC10:27
*** zul has joined #openstack-infra10:27
*** jlanoux has joined #openstack-infra10:27
*** e0ne has quit IRC10:29
*** jlanoux_ has quit IRC10:29
*** tosky has joined #openstack-infra10:30
*** pblaho has quit IRC10:32
*** lennyb has joined #openstack-infra10:37
*** e0ne has joined #openstack-infra10:37
*** rbuzatu has quit IRC10:38
*** sorantis has quit IRC10:38
*** rbuzatu has joined #openstack-infra10:40
*** amotoki has quit IRC10:41
openstackgerritVitaly Gridnev proposed openstack-infra/project-config: [sahara-dashboard] add py27dj110 testenv  https://review.openstack.org/34645710:42
*** rbuzatu has quit IRC10:43
*** gildub has joined #openstack-infra10:44
Srinuhi10:44
*** Ravikiran_K has quit IRC10:45
Srinui have two jobs in check pipeline and i am using single slave and i want to run the 2 jobs sequentially on the slave10:45
*** rbuzatu has joined #openstack-infra10:45
*** tonytan4ever has joined #openstack-infra10:46
*** sorantis has joined #openstack-infra10:46
*** rbuzatu has quit IRC10:47
*** e0ne has quit IRC10:47
*** rbuzatu has joined #openstack-infra10:48
*** tonytan4ever has quit IRC10:50
*** javeriak has joined #openstack-infra10:52
*** rbuzatu has quit IRC10:52
*** jlanoux has quit IRC10:52
*** pblaho has joined #openstack-infra10:54
*** rbuzatu has joined #openstack-infra10:54
*** jlanoux has joined #openstack-infra10:55
*** salv-orlando has quit IRC10:56
openstackgerritXiang Chen proposed openstack/diskimage-builder: check APT_SOURCES earlier  https://review.openstack.org/34660511:01
*** ams__ has joined #openstack-infra11:03
*** sorantis_ has joined #openstack-infra11:04
openstackgerritgaryk proposed openstack-infra/project-config: Networking-l2gw: enable python 3 gating  https://review.openstack.org/34670111:05
*** yamamot__ has quit IRC11:05
garykihrachys: AJaeger: ^11:05
*** rbuzatu has quit IRC11:05
*** sree has joined #openstack-infra11:06
garykcan you guys please take a look. i have completed the l2-gw code and the tests pass locally. it would be nice if we could have this in gerrit as it will help those patches along11:06
*** sorantis has quit IRC11:07
*** sorantis_ is now known as sorantis11:07
*** amotoki has joined #openstack-infra11:07
*** rbuzatu has joined #openstack-infra11:07
azvyagintsevFolks, could you please take a look - what is wrong with https://review.openstack.org/#/c/344838/ ?11:08
*** szaher has quit IRC11:09
*** rbuzatu has quit IRC11:09
openstackgerritXiang Chen proposed openstack-infra/project-config: add a keep-proxy element  https://review.openstack.org/34661911:10
*** rbuzatu has joined #openstack-infra11:10
*** sree has quit IRC11:10
*** amotoki has quit IRC11:11
*** thorst has joined #openstack-infra11:11
*** tqtran has joined #openstack-infra11:12
*** M-docaedo_vector has quit IRC11:12
*** sdague has joined #openstack-infra11:13
openstackgerritIvan Udovichenko proposed openstack-infra/project-config: Add automatic backports  https://review.openstack.org/34609511:13
*** tqtran has quit IRC11:16
*** trown|outtypewww is now known as trown11:17
*** gildub_ has joined #openstack-infra11:17
*** weshay has quit IRC11:19
*** hosanai has quit IRC11:19
*** sarob has joined #openstack-infra11:20
odyssey4meandymccr the latest mitaka sha update: https://review.openstack.org/34230911:22
*** rbuzatu has quit IRC11:23
*** Na3iL has quit IRC11:23
*** Goneri has quit IRC11:24
*** rbuzatu has joined #openstack-infra11:24
*** sarob has quit IRC11:24
*** rbuzatu has quit IRC11:29
*** gildub_ has quit IRC11:29
*** gildub has quit IRC11:29
*** gildub has joined #openstack-infra11:30
*** Goneri has joined #openstack-infra11:31
*** ljjjustin has quit IRC11:31
*** jkilpatr has joined #openstack-infra11:31
*** ljjjustin has joined #openstack-infra11:32
*** salv-orlando has joined #openstack-infra11:33
*** M-docaedo_vector has joined #openstack-infra11:37
*** rbuzatu has joined #openstack-infra11:37
*** sorantis has quit IRC11:38
*** lucasagomes is now known as lucas-hungry11:38
*** dizquierdo has quit IRC11:39
*** e0ne has joined #openstack-infra11:39
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job  https://review.openstack.org/22978911:40
openstackgerrityolanda.robla proposed openstack-infra/tripleo-ci: Add --yes flags to heat stack-delete for liberty  https://review.openstack.org/34720211:42
*** sandanar_ has joined #openstack-infra11:43
*** asettle has quit IRC11:45
*** sandanar__ has quit IRC11:47
*** sandanar__ has joined #openstack-infra11:47
*** sarob has joined #openstack-infra11:48
*** yamamoto has joined #openstack-infra11:51
*** sandanar_ has quit IRC11:51
*** dkehn has quit IRC11:52
*** rhallisey has joined #openstack-infra11:53
*** weshay has joined #openstack-infra11:53
*** sarob has quit IRC11:53
openstackgerritVitaly Gridnev proposed openstack-infra/project-config: setup voting for py35 jobs in sahara projects  https://review.openstack.org/34729111:54
*** sree has joined #openstack-infra11:55
openstackgerritIvan Udovichenko proposed openstack-infra/project-config: Add automatic backports  https://review.openstack.org/34609511:55
*** rfolco has joined #openstack-infra11:56
openstackgerritIvan Udovichenko proposed openstack-infra/project-config: Add job to build generic debian packages  https://review.openstack.org/30774211:56
openstackgerritJulien Danjou proposed openstack-infra/project-config: Run Gnocchi MySQL jobs on Ubuntu Xenial  https://review.openstack.org/34729511:57
*** yamamoto has quit IRC11:57
*** psilvad has joined #openstack-infra11:59
*** rossella_s has quit IRC11:59
*** sree has quit IRC12:00
*** sandanar_ has joined #openstack-infra12:00
*** rossella_s has joined #openstack-infra12:00
*** shardy is now known as shardy_lunch12:01
*** rbuzatu has quit IRC12:02
*** yamamoto has joined #openstack-infra12:02
*** sandanar__ has quit IRC12:04
*** psilvad has quit IRC12:05
*** markusry has joined #openstack-infra12:05
openstackgerritDinesh Bhor proposed openstack-dev/pbr: Replace OpenStack LLC with OpenStack Foundation  https://review.openstack.org/34729912:07
*** rbuzatu has joined #openstack-infra12:08
odyssey4mehmm, that's odd - all of a sudden I'm seeing that ubuntu trusty jobs are missing from being executed for ansible role jobs12:11
odyssey4mepabelanger ^12:11
odyssey4mean example: https://review.openstack.org/#/c/344912/12:11
*** ldnunes has joined #openstack-infra12:15
*** psilvad has joined #openstack-infra12:16
*** gema has quit IRC12:16
*** aysyd has joined #openstack-infra12:16
*** markusry has quit IRC12:17
*** edmondsw has joined #openstack-infra12:17
*** Liuqing has joined #openstack-infra12:17
azvyagintsevodyssey4me: fungi: https://review.openstack.org/#/c/344838/ can you suggest, whats happened with check ?(12:18
odyssey4meazvyagintsev http://logs.openstack.org/38/344838/11/check/gate-project-config-layout/d70b7b6/console.html#_2016-07-26_09_06_03_61298112:19
*** kgiusti has joined #openstack-infra12:21
odyssey4meazvyagintsev not sure, I think you may have to pull       - name: noop-jobs out though12:21
*** jlanoux has quit IRC12:23
*** jlanoux has joined #openstack-infra12:24
*** gildub has quit IRC12:26
*** asettle has joined #openstack-infra12:27
*** ericksonsantos has joined #openstack-infra12:27
*** Goneri has quit IRC12:30
*** mdrabe has joined #openstack-infra12:31
*** markusry has joined #openstack-infra12:31
openstackgerritXiang Chen proposed openstack-infra/project-config: add a keep-proxy element  https://review.openstack.org/34661912:34
*** julim has quit IRC12:35
*** gouthamr has joined #openstack-infra12:35
*** rodrigods has quit IRC12:35
*** rodrigods has joined #openstack-infra12:35
*** Na3iL has joined #openstack-infra12:36
*** gouthamr has quit IRC12:36
*** moravec has quit IRC12:36
*** javeriak_ has joined #openstack-infra12:37
*** rbuzatu has quit IRC12:38
*** lucas-hungry is now known as lucasagomes12:39
*** javeriak has quit IRC12:39
openstackgerritAleksey Zvyagintsev proposed openstack-infra/project-config: [murano-apps] add 'gate-murano-apps-linters' job  https://review.openstack.org/34483812:39
*** jcoufal has joined #openstack-infra12:40
openstackgerritVitaly Gridnev proposed openstack-infra/project-config: setup voting for py35 jobs in sahara projects  https://review.openstack.org/34729112:41
*** rbuzatu has joined #openstack-infra12:42
*** rlandy has joined #openstack-infra12:42
*** tpsilva has joined #openstack-infra12:42
openstackgerritCarlos Camacho proposed openstack-infra/project-config: Add TripleO gate jobs to the same job  https://review.openstack.org/34734812:46
*** baoli has joined #openstack-infra12:47
openstackgerritHonza Pokorny proposed openstack-infra/project-config: Upload tarballs for tripleo-ui  https://review.openstack.org/34383412:47
*** piet_ has joined #openstack-infra12:48
*** Goneri has joined #openstack-infra12:48
*** akshai has joined #openstack-infra12:50
*** javeriak_ has quit IRC12:50
*** ddieterly has joined #openstack-infra12:51
*** jsavak has joined #openstack-infra12:51
*** mhickey has joined #openstack-infra12:52
*** sree has joined #openstack-infra12:52
*** zz_dimtruck is now known as dimtruck12:53
*** yanyanhu has joined #openstack-infra12:54
azvyagintsevodyssey4me on local tox run i catch 'RuntimeError: maximum recursion depth exceeded12:55
azvyagintsev' in zuul run...cool )12:55
odyssey4meazvyagintsev oh dear12:56
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Use scp to copy deploy.env to subnodes  https://review.openstack.org/34699812:56
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Break out bootstrapping of subnodes setup  https://review.openstack.org/34700812:56
*** sree has quit IRC12:57
*** hashar is now known as hasharAway12:57
*** javeriak has joined #openstack-infra12:58
*** dmsimard is now known as dmsimard|afk12:58
*** woodster_ has joined #openstack-infra12:58
*** signed8bit has joined #openstack-infra13:00
*** gouthamr has joined #openstack-infra13:00
openstackgerritAlexey Weyl proposed openstack-infra/project-config: Vitrage tempests  https://review.openstack.org/34735913:01
*** asettle has quit IRC13:01
*** garyk has quit IRC13:01
*** asettle has joined #openstack-infra13:02
*** yamamoto has quit IRC13:03
*** baoli has quit IRC13:03
*** garyk has joined #openstack-infra13:03
*** psachin has quit IRC13:06
*** Liuqing has quit IRC13:06
*** Liuqing has joined #openstack-infra13:08
*** piet_ has quit IRC13:09
*** pt_15 has joined #openstack-infra13:13
*** zz_zz_zz_ja has quit IRC13:13
mikafungi: is there any chance that a new git-review release might get tagged? :) 1.25.0 was 13 months ago and there are some changes in between which might be good to get to users :)13:13
*** ddieterly has quit IRC13:13
*** Liuqing has quit IRC13:14
pkarikhHi folks! Could someone help me with understanding of how our gerrit `Depends-On` tag works?13:14
*** Liuqing has joined #openstack-infra13:15
*** yamamoto has joined #openstack-infra13:15
*** shardy_lunch is now known as shardy13:15
*** yamamoto has quit IRC13:15
pkarikhCan't find out if I do not understand what should or it just doesn't work.13:16
*** yamamoto has joined #openstack-infra13:16
azvyagintsevpkarikh: as i know, this mean : this patch will be merged, after depends-on patch merge13:17
pkarikhazvyagintsev, hmm. I thought that it makes gerrit fetch some lib not from src but from specific gerrit commit. Am I wrong?13:18
openstackgerritIvan Udovichenko proposed openstack-infra/project-config: Add new projects  https://review.openstack.org/34704713:18
*** Liuqing has quit IRC13:19
*** matt-borland has joined #openstack-infra13:19
azvyagintsevpkarikh: yup, you are true - my mistake, i confuse it with 'Require' tag..sorry13:19
pkarikhazvyagintsev, no problem. :) Actually I can't find out why I set Depends-On to fetch osprofiler but gerrit says that it cant satisfy constraints for 'osprofiler' here: http://logs.openstack.org/75/339675/8/check/gate-horizon-pep8/e0bbb84/console.html#_2016-07-25_23_39_47_05857913:21
*** yamamoto has quit IRC13:21
*** yamamoto has joined #openstack-infra13:21
*** alexey_weyl has joined #openstack-infra13:23
alexey_weylHi,13:23
alexey_weylCan you please approve my change in the Vitrage project: https://review.openstack.org/#/c/347359/13:24
*** julim has joined #openstack-infra13:24
*** hasharAway is now known as hashar13:25
tlbrpabelanger, hi, could you please review/merge https://review.openstack.org/#/c/307742/ https://review.openstack.org/#/c/346095/13:25
*** nmagnezi has quit IRC13:26
*** yamamoto has quit IRC13:27
*** pgadiya has quit IRC13:29
*** moravec has joined #openstack-infra13:32
openstackgerritamrith proposed openstack-infra/irc-meetings: Fix the start date to be today  https://review.openstack.org/34738813:34
*** xenogear_ has joined #openstack-infra13:34
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Add support for sqlalchemy reporter  https://review.openstack.org/22333313:34
openstackgerritamrith proposed openstack-infra/irc-meetings: Fix the SWG Team meeting start date to be today  https://review.openstack.org/34738813:35
*** mriedem has joined #openstack-infra13:35
*** yanyanhu has quit IRC13:36
zigotlbr: pabelanger: I'm back.13:36
*** yanyanhu has joined #openstack-infra13:37
*** sree has joined #openstack-infra13:41
*** ddieterly has joined #openstack-infra13:43
*** links has quit IRC13:44
*** sree has quit IRC13:46
*** esberglu has joined #openstack-infra13:46
*** alexey_weyl has quit IRC13:46
*** ayoung has joined #openstack-infra13:48
*** garyk1 has joined #openstack-infra13:50
*** garyk has quit IRC13:50
*** tonytan4ever has joined #openstack-infra13:52
*** yamamoto has joined #openstack-infra13:52
*** yamamoto has quit IRC13:52
*** yamamoto has joined #openstack-infra13:52
*** dimtruck is now known as zz_dimtruck13:54
*** jcoufal has quit IRC13:54
*** ddieterly has quit IRC13:55
*** ddieterly has joined #openstack-infra13:56
*** dizquierdo has joined #openstack-infra13:57
*** yamamoto has quit IRC13:58
*** yamamoto has joined #openstack-infra13:59
*** xarses_ has quit IRC14:00
*** zhurong has joined #openstack-infra14:01
*** xyang1 has joined #openstack-infra14:02
*** javeriak has quit IRC14:04
*** yanyanhu has quit IRC14:04
*** zhurong has quit IRC14:05
*** zhurong has joined #openstack-infra14:06
*** jcoufal has joined #openstack-infra14:06
*** PollyZ has joined #openstack-infra14:07
*** mhickey has quit IRC14:07
*** mdrabe has quit IRC14:09
*** garyk1 has quit IRC14:09
*** atom_ has quit IRC14:10
jd__are we getting spam on Gerrit now ? cf https://review.openstack.org/#/c/265829/14:10
*** inc0 has joined #openstack-infra14:10
*** rbrndt has joined #openstack-infra14:10
*** thiagop has joined #openstack-infra14:12
*** zz_dimtruck is now known as dimtruck14:13
*** tqtran has joined #openstack-infra14:13
*** sdake has joined #openstack-infra14:14
pabelangerodyssey4me: looks like an issue with the skip logic we added for ubuntu-trusty. let me see if I can fix the regex14:14
mordredjd__: uhm. wow14:14
odyssey4mepabelanger ah, I was confused because all the jobs looked right14:15
odyssey4meI didn't think to look for new skips14:15
*** zhurong has quit IRC14:16
pabelangerodyssey4me: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n110614:16
*** gordc has joined #openstack-infra14:16
*** zhurong has joined #openstack-infra14:16
openstackgerritBrant Knudson proposed openstack-infra/devstack-gate: Enable tlsproxy by default  https://review.openstack.org/29677114:17
odyssey4mewow, that is far too broad14:17
pabelangerodyssey4me: so, I believe our fix is to update that to account for existing ubuntu-trusty jobs that want to run on master14:17
odyssey4mewe intend to continue support for trusty for Newton and Ocata... so that's no good14:17
pabelangerodyssey4me: ya, lets see what clarkb says14:17
odyssey4mewell, we hope to - assuming that's actually possible14:17
*** zz_ja has joined #openstack-infra14:18
*** sdake_ has joined #openstack-infra14:18
*** baoli has joined #openstack-infra14:18
*** tqtran has quit IRC14:18
odyssey4mepabelanger that will need to skip, at least, any jobs containing 'openstack-ansible'14:19
openstackgerritJulien Danjou proposed openstack-infra/project-config: Run Gnocchi MySQL jobs on Ubuntu Xenial  https://review.openstack.org/34729514:20
*** baoli_ has joined #openstack-infra14:20
*** sdake has quit IRC14:20
*** PollyZ has quit IRC14:21
pabelangerodyssey4me: Ya, I suspect that logic will grow for each project14:21
azvyagintsevpabelanger hi. could you please take a look https://review.openstack.org/#/c/344838/ ? i had some issues with jenkins-check, but can't understand how-to fix it...14:21
*** mhickey has joined #openstack-infra14:21
odyssey4mepabelanger perhaps it should only exclude that oplatform for a more specific list of projects?14:21
*** psachin has joined #openstack-infra14:21
azvyagintsevodyssey4me: noop-job removing didn't help(14:21
*** psachin has quit IRC14:22
*** mtanino has joined #openstack-infra14:22
*** hongbin has joined #openstack-infra14:22
*** oanson has quit IRC14:22
*** baoli has quit IRC14:23
AJaegerpkarikh: read http://docs.openstack.org/infra/manual/developers.html#cross-repository-dependencies - including the limitations section14:25
*** raildo has joined #openstack-infra14:25
*** e0ne has quit IRC14:27
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Implement undercloud upgrade job  https://review.openstack.org/34699514:27
*** psachin has joined #openstack-infra14:29
*** tosky has quit IRC14:30
*** rbuzatu has quit IRC14:30
*** EricGonczer_ has joined #openstack-infra14:31
openstackgerritHonza Pokorny proposed openstack-infra/project-config: Upload tarballs for tripleo-ui  https://review.openstack.org/34383414:31
EmilienMwe have a spammer on #openstack-meeting-alt14:31
EmilienMfungi: ^14:31
pkarikhAJaeger, yep, I seen this chapter. But I have no osprofiler it requirements, so it shouldn't be installed from pypi.14:32
EmilienMsomeone IRC admin around?14:32
EmilienMpabelanger, mordred14:32
EmilienMwe got spammed on alt meeting chan14:33
AJaegerpkarikh: if your job is configured to isntall osprofiler in all situations from git, your depends-on will update it. If your job is setup to install osprofile from pypi, it will always do so.14:34
*** Liuqing has joined #openstack-infra14:34
AJaegerdepends-on says: If you check out a git tree, apply this change14:34
AJaegerazvyagintsev: commented14:34
*** caowei has joined #openstack-infra14:35
*** rbuzatu has joined #openstack-infra14:35
AJaegerpabelanger or any other project-config core: could you review https://review.openstack.org/#/c/344955/ , please? That moves us forward with constraints...14:35
pabelangermordred: EmilienM: somebody just banned something in #openstack-meeting-alt14:36
pabelangerAJaeger: +314:37
AJaegerthanks, pabelanger14:37
EmilienMpabelanger: he's not banned14:37
AJaegerpabelanger: that one is back ;(14:38
*** roxanaghe has joined #openstack-infra14:38
pabelangerEmilienM: I need to get ops, 1 sec14:39
*** rbuzatu has quit IRC14:39
*** pabelanger has quit IRC14:39
*** pabelanger has joined #openstack-infra14:39
*** mhickey has quit IRC14:40
*** hwcomcn has quit IRC14:40
pabelangerEmilienM: sadly, I don't have the instructions to do it. I'm not able to get ops in #openstack-meeting-alt14:41
EmilienMok14:41
pabelangermordred: fungi: pleia2: do you have a moment?^14:41
*** zhenguo has quit IRC14:41
*** adrian_otto has joined #openstack-infra14:42
*** rbuzatu has joined #openstack-infra14:42
fungijd__: that's not the first incident we've seen. i think we disabled an account a few weeks ago and deleted similar comments from it and corvus whipped up a script to semi-automate that14:42
AJaegerpabelanger: http://docs.openstack.org/infra/system-config/irc.html#basic-channel-operator-commands14:42
jd__fungi: :(14:42
*** roxanaghe has quit IRC14:42
corvusjd__, fungi: zaro did get a patch merged to upstream gerrit to make those links rel=nofollow14:43
pabelangerAJaeger: Ya, I can't get ops14:43
*** rbuzatu has quit IRC14:43
corvusso once that starts rolling out, it should reduce the value of gerrit as a target for spammers14:43
jrollfungi: I've seen them on other networks too :/14:43
corvus(still might take them a while to notice though)14:43
*** xarses_ has joined #openstack-infra14:44
fungijroll: other gerrit servers?14:44
*** rbuzatu has joined #openstack-infra14:44
jrollfungi: oh, I misread, I meant the allah irc spam14:44
AJaegerpabelanger: indeed, you're not in the ops list.14:44
jrollignore me :)14:44
fungiEmilienM: i added that user to the akick list for the channel14:44
EmilienMfungi: thanks14:44
pabelangerAJaeger: ya, looking for that14:44
corvusfungi: system-config/tools/delete-gerrit-spam.py14:44
corvusany other infra-root want to run that ^ ?14:45
AJaegerpabelanger: project-config/accessbot/channels.yaml14:45
pabelangerfungi: when you have a moment, do you mind sharing the syntax used?14:45
*** rbuzatu has quit IRC14:45
pabelangerAJaeger: perfect, thanks14:45
*** rbuzatu has joined #openstack-infra14:45
*** PollyZ has joined #openstack-infra14:45
fungipabelanger: /msg chanserv akick #openstack-meeting-alt add Guest_48743 spamming is off-topic14:46
fungiis what i've been doing14:46
AJaegerfungi, pabelanger did not have ops permissions, he needs to be added to accessbot first14:46
fungithough last time this came up there seemed to be some consensus we should just block Guest_.*14:46
fungion the grounds that meeting participants should use proper nicks14:46
jrollI've seen a few community members talk as guest_* for a bit before realizing it14:47
corvusfungi, pabelanger: can you add that to system-config/doc/source/irc.rst ?14:47
fungisure, adding now14:47
*** matrohon has joined #openstack-infra14:47
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add pabelanger as channel operator  https://review.openstack.org/34743114:47
openstackgerritMerged openstack-infra/project-config: Remove tripleo-test-cloud-rh1 from nodepool  https://review.openstack.org/34713814:48
pabelangerfungi: corvus: Thanks for adding it14:48
corvusfungi: https://review.openstack.org/345540  adds rel=nofollow14:49
openstackgerritMerged openstack-infra/project-config: Test constraints for release-notes  https://review.openstack.org/34495514:49
*** cody-somerville has quit IRC14:49
AJaegerfungi, corvus: Could you review 347431, please? I'd like infra-root's to +2...14:49
clarkbpabelanger: odyssey4me are there a bunch of -ubuntu-trusty jobs that need to run on older branches? is that the problem?14:49
*** cody-somerville has joined #openstack-infra14:49
odyssey4meclarkb there are a bunch of -ubuntu-trusty jobs that need to run on master, that aren't running14:50
clarkbpabelanger: odyssey4me thats easy to do we just need a new rule that updates the branch param14:50
clarkbfor those jobs14:50
corvusno one wants to run the delete-spam script?14:50
pabelangerclarkb: ya, I wanted to see your thoughts first14:50
mtreinishfungi: if you get a sec: https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+branch:master+topic:firehose should be a fast +A14:50
pabelangercorvus: I can give it a go if nobody else wants too14:50
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add documentation about Chanserv's auto-kick list  https://review.openstack.org/34743214:51
fungipabelanger: corvus: ^14:51
clarkbpabelanger: odyssey4me its fine by me, we wont not delete those trusty nodes because random prpject wants to support them beyond what is sane though14:51
corvuspabelanger: cool, first you need an account id14:52
*** HeOS has quit IRC14:52
odyssey4meclarkb we're aiming to support trusty through Newton and probably Ocata to give our deployers a chance to migrate appropriately14:52
*** mhickey has joined #openstack-infra14:52
pabelangercorvus: okay, looking for that now14:52
*** aderyugin has quit IRC14:52
*** aderyugin has joined #openstack-infra14:53
*** atom_ has joined #openstack-infra14:53
*** HeOS has joined #openstack-infra14:53
AJaegerclarkb: for projects that don't have stable branches, do we need ubuntu-trusty jobs? First cleanup for documentation projects: https://review.openstack.org/34714714:53
corvuspabelanger, fungi: i can find it with a gsql query -- is there a better way?14:53
fungicorvus: zaro: so i guess we need a system-config patch to use the latest warfile from our gerrit fork on review.o.o and then after the next restart we'll have 345540 (rel=nofollow) in production?14:53
pabelangercorvus: I'm not sure, I haven't searched for an gerrit id before14:53
clarkbAJaeger: I think in the general case no. Its possible there is a few where we might try to work something out14:54
*** jokke_ has quit IRC14:54
*** aderyugin has quit IRC14:54
tlbrguys, could please someone review/merge https://review.openstack.org/#/c/307742/ https://review.openstack.org/#/c/346095/ ?14:54
corvusfungi: we do need to land 540 first14:54
rajinirIs devstack supported on Ubuntu 16.04?14:54
*** aderyugin has joined #openstack-infra14:54
clarkbodyssey4me: pabelanger should I write the fix or is one already written? and is it for the openstack-ansible jobs?14:54
corvuspabelanger: you know about gsql?14:54
fungicorvus: still catching up in channel but i'm happy to run the delete spam script. need to squeeze it into the next 5 minutes though since i'm about to miltitask between a conference call and an irc meeting at 15:0014:54
corvusfungi: pabelanger has volunteered14:55
clarkbrajinir: sort of? we havent started gating on it but intend to real soon now14:55
fungipabelanger: thanks!14:55
odyssey4meclarkb I'm not sure about other projects, but yes - openstack-ansible jobs are certainly something that skip must not activate for14:55
*** aderyugin has quit IRC14:55
AJaegerclarkb: so, that change is fine? Note I'm not planning to check other projects for such situations, just stumpled upone these two... But this is important also for new project addition14:55
fungione less thing for me to worry about ;)14:55
openstackgerritAleksey Zvyagintsev proposed openstack-infra/project-config: [murano-apps] add 'gate-murano-apps-linters' job  https://review.openstack.org/34483814:55
fungiin positive news, i woke up to no new spammer accounts on wiki.o.o14:56
pabelangercorvus: I have not used it before14:56
rajinirclarkb: What is recommended now? We are seeing some issues with 16.04 and don't want to debug those if it is not yet used by the community14:56
azvyagintsevAJaeger: thx! (diff 'check' section with other's few time...have no idea how miss it )14:56
smcginnisI have an odd doc build issue I can't figure out. Hoping someone here can take a look and have a clue.14:56
smcginnisI added a command to our docs build: https://review.openstack.org/#/c/346470/5/tox.ini14:56
AJaegerclarkb: Oh, the ubuntu-trusty might apply for project-config as well, see bindep-fallback template.14:57
smcginnisI see that command being run in a local build, but the check queue output does not include it.14:57
smcginnishttp://paste.openstack.org/show/542121/14:57
openstackgerritamrith proposed openstack-infra/irc-meetings: Update agenda for SWG Meeting  https://review.openstack.org/34743814:57
smcginnisSo the resulting docs are missing the data I'm trying to add.14:57
*** adrian_otto has quit IRC14:57
AJaegersmcginnis: we run "python setup.py build_sphinx" for the docs job14:57
smcginnisAny help or pointers would be appreciated.14:57
*** xarses_ is now known as xarses14:57
smcginnisAJaeger: So not the "docs" tox target?14:57
*** mdrabe has joined #openstack-infra14:57
AJaegersmcginnis: indeed, not the docs target14:57
smcginnisbummer14:58
smcginnisSo I would need to write this in as a sphinx extension I suppose.14:58
*** Teresita-Warrior has joined #openstack-infra14:58
* AJaeger has to leave again...14:59
rcarrillocruzcorvus: heya, in http://specs.openstack.org/openstack-infra/infra-specs/specs/zuulv3.html#jobs it shows the password is a dict containing key/value pairs for creds. Does it mean a job may contain more than one password ?14:59
*** aderyugin has joined #openstack-infra15:00
*** bin_ has joined #openstack-infra15:00
corvusrcarrillocruz: yes -- a job might need multiple credentials in order to run (maybe one to upload a tarball and another to upload logs or something)15:01
*** coolsvap is now known as coolsvap_15:01
pabelangercorvus: I believe 22723 is our id15:01
corvusrcarrillocruz: also, on the swift thing -- i haven't seen jhesketh around yet, but i was thinking that since the tempurl code is already written, maybe we should go ahead and set it up to use that, but also so that if we want to expand it for normal authenticated swift in the future, we can.15:02
fungismcginnis: it needs to get explained often, unfortunately http://lists.openstack.org/pipermail/openstack-dev/2016-July/099208.html15:03
openstackgerritClark Boylan proposed openstack-infra/project-config: Run openstack ansible jobs on trusty  https://review.openstack.org/34744015:03
corvusrcarrillocruz: so maybe we should put the swift tempurl feature in as "auth: swift-tempurl: ..."  ?15:03
corvuspabelanger: agreed15:03
clarkbodyssey4me: pabelanger ^ ok that should do it because the branch rule is last match wins15:03
pabelangercorvus: http://paste.openstack.org/show/542123/ looks like the correct user15:03
rcarrillocruzgood, i assumed correctly about multiple creds then15:03
rcarrillocruzcorvus: he commented on https://review.openstack.org/#/c/346914/315:03
rcarrillocruzi think we have a disconnect here on whether swift should be within auth or not15:04
rcarrillocruzi made the change to be within auth, as per the spec examples15:04
rcarrillocruzah15:04
rcarrillocruzso, swift within auth for authenticated swift15:04
rcarrillocruzoutside swift for tempurl15:04
rcarrillocruz?15:04
rcarrillocruzso keep both?15:04
*** rcernin has quit IRC15:05
pabelangercorvus: okay, comments deleted. Should we also mark the account inactive?15:05
openstackgerritMerged openstack-infra/project-config: Add api-ref jobs for Manila  https://review.openstack.org/31387515:05
corvusrcarrillocruz: i believe anything related to swift should be inside of auth.  so "auth: swift-tempurl" for the current code, then in the future, "auth: swift" for authenticated swift15:05
rcarrillocruzaha15:05
corvusrcarrillocruz: i'll reply on the change too15:05
rcarrillocruzthx15:06
*** hashar is now known as hasharAway15:06
smcginnisfungi: Ah, thanks for the pointer.15:07
*** EricGonczer_ has quit IRC15:08
*** csomerville has joined #openstack-infra15:09
anteayapabelanger: yes please15:09
clarkbanteaya: maybe you can review https://review.openstack.org/347440 to get openstack ansible and odyssey4me happy again15:10
anteayaI can look at it15:10
* anteaya does so15:10
anteayaclarkb: looks good to me, thank you15:11
odyssey4meclarkb anteaya quick comment on it15:11
*** cody-somerville has quit IRC15:12
clarkbodyssey4me: kk will correct15:12
*** yamahata has joined #openstack-infra15:12
rcarrillocruzwootz15:12
odyssey4meclarkb also, aren't you missing the slash?15:12
rcarrillocruzpresentations voting are live15:12
openstackgerritClark Boylan proposed openstack-infra/project-config: Run openstack ansible jobs on trusty  https://review.openstack.org/34744015:13
clarkbodyssey4me: bah15:13
clarkbits early morning thats my excuse15:13
anteayaodyssey4me: good eye15:13
* anteaya accepts clarkb's excuse15:14
openstackgerritClark Boylan proposed openstack-infra/project-config: Run openstack ansible jobs on trusty  https://review.openstack.org/34744015:14
clarkbodyssey4me: ^ there matches both liberty and stable/liberty should you choose to change15:14
clarkband has a /15:14
odyssey4meLGTM15:14
anteayayay!15:15
anteayaclarkb: +215:15
clarkbpabelanger: ^ should be ready for you now :)15:15
clarkbI have also pushed up a change to deal with coverage jobs. I wonder if that has conflcited yet. But next is time to work on the devstack/tempest switch I think15:16
clarkbpabelanger: ^ you may have interest in that bit15:16
pabelangeranteaya: corvus: account marked inactive15:16
anteayapabelanger: does that account have any open connections? do you need to close any15:17
anteayapabelanger: and thank you for deactivating it15:17
pabelangeranteaya: oh, didn't know I needed to check that15:17
pabelangeranteaya: ah, step 315:18
pabelangerdoing that now15:18
openstackgerritAleksey Zvyagintsev proposed openstack-infra/project-config: [murano-apps] add 'gate-murano-apps-linters' job  https://review.openstack.org/34483815:18
anteayapabelanger: thanks15:19
*** yamamoto has quit IRC15:19
anteayapabelanger: it is most important with errant third party ci accounts, but may as well build the habit15:19
*** acruz has quit IRC15:19
pabelangeranteaya: seems like a good step to do15:19
anteayapabelanger: thanks, I agree15:20
mgagneHas anyone encountered this issue with nodepool? http://paste.openstack.org/show/542129/ Happened since we upgraded to Kilo. Was it fixed in a latest version of shade?15:20
openstackgerritZara proposed openstack-infra/python-storyboardclient: Add support for private stories  https://review.openstack.org/34744815:20
mgagne"Image creation failed: None is not of type u'integer'"15:20
*** Ahharu has quit IRC15:21
clarkbmgagne: I don't think we have seen that problem implying that shade does handle it for us15:21
clarkbbut may be we also changed nodepool15:22
mgagneok, will continue to investigate15:22
vgridnevhi folks, just saw that voting for summit talks is started, but I can't see abstract of any talk, is it expected?15:22
mgagneI have yet to migrate to clouds.yaml so =)15:22
pabelangerclarkb: +315:22
clarkbmgagne: looks like nodepool hands that all over to shade so I don't think nodepool is handling it directly15:22
*** matrohon has quit IRC15:22
mgagneyea, that's why I suspected shade. I will try to reup the image and see if it was an intermittent issue or not15:23
anteayavgridnev: you have to ask the folks that maintain that website15:23
*** Guest51132 is now known as med_15:23
*** med_ has quit IRC15:24
*** med_ has joined #openstack-infra15:24
anteayavgridnev: filing a bug seems to be their prefered method of communication: https://bugs.launchpad.net/openstack-org15:24
*** aderyugin has quit IRC15:24
*** aderyugin has joined #openstack-infra15:24
*** zhurong has quit IRC15:25
*** tosky has joined #openstack-infra15:25
*** nmagnezi has joined #openstack-infra15:25
rcarrillocruzmgagne: if you could reproduce this , please open a bug on Storyboard15:27
rcarrillocruzi'll pick it up15:27
openstackgerritMerged openstack-infra/irc-meetings: Fix the SWG Team meeting start date to be today  https://review.openstack.org/34738815:27
anteayavgridnev: based on a private email I just got, I would have to say you are not alone and it is a bug15:27
anteayavgridnev: if you file a bug then we can point other folks to it as well15:28
vgridnevanteaya, https://bugs.launchpad.net/openstack-org/+bug/160660315:28
openstackLaunchpad bug 1606603 in openstack-org "Can't see the abstract part of votes for summit talks " [Undecided,New]15:28
anteayavgridnev: thank you15:28
pabelangercorvus: clarkb: fungi: I'm going to start rolling restarts of zuul-launcher to pick up our remote_tmp fixes from yesterday. I'll start with zlstatic01.o.o then move to cleaning up $HOME/.ansible on our static workers15:29
*** Liuqing has quit IRC15:29
fungipabelanger: thanks! might also consider another pass cleaning up the launchers too for new cruft since yesterday (though not essential)15:30
corvuspabelanger: ++15:30
pabelangerfungi: agreed15:30
*** nmagnezi has quit IRC15:31
*** vincentll has quit IRC15:31
anteayaclarkb: so far do you notice any other fall out from 344959?15:32
clarkbanteaya: not from what I am seeing this morning15:33
clarkbanteaya: we will likely want to bump the ubuntu-xenial min ready soonish though15:33
anteayaclarkb: wonderful15:33
anteayaah, good point15:33
anteayaclarkb: do you want to do that?15:34
anteayaor was that a hint that I should?15:34
*** piet_ has joined #openstack-infra15:34
clarkbanyone can :) I am currently in boot morning mode which means keep on kid happy with unplugged keybaord in front of my keyboard while I figure out breakfast15:35
anteayahttp://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/nodepool.yaml#n7915:35
anteayaclarkb: ah okay, I will, it is currently 3, have you a suggestion of what it should be?15:35
*** armax has joined #openstack-infra15:35
clarkbanteaya: maybe half of what ubuntu-trusty is and cut ubuntu trusty in half ish15:36
rcarrillocruzi can do15:36
rcarrillocruzanteaya , clarkb ^15:36
rcarrillocruzgive me a sec15:36
clarkbI think we may have roughly shifted the demand that way, reduced ubuntu-trusty by half and bumped ubuntu-xenial to that level15:36
anteayarcarrillocruz: oh you want to do it?15:36
anteayaclarkb: makes sense15:36
rcarrillocruzis there some context? just to put in the commit msg15:36
clarkbthen when we switch the tempest and devstack jobs over ubuntu-trusty will be minimalized15:36
rcarrillocruzi mean, why halving the trusty ones,15:37
rcarrillocruzdue to low ci resources or...15:37
rcarrillocruz?15:37
clarkbrcarrillocruz: its because we just switched all of the python-jobs to use xenial on master15:37
anteayarcarrillocruz: this is a follow up from a change that merged yesterday15:37
clarkbrcarrillocruz: so we increased the demand for ubuntu-xenial by a significant factor and reduced ubuntu-trusty by the same amount ish15:37
rcarrillocruzah sweet15:37
anteayawhich clarkb had been working on and which I had been helping with15:38
rcarrillocruzso the change is 34495915:38
rcarrillocruz?15:38
clarkbrcarrillocruz: ya15:38
rcarrillocruzk15:38
rcarrillocruzlet me create a branch, i will push shortly15:38
corvusfungi, ttx, jpmaxman: the 'community voting now open' email i got says 'community voting is now open' in the first paragraph, but then, below that, it appears to be a copy of the 'call for presentations ends this week' email.15:38
*** Jokke_ has joined #openstack-infra15:38
*** Jokke_ has quit IRC15:38
*** Jokke_ has joined #openstack-infra15:38
*** psachin has quit IRC15:40
*** ramishra has quit IRC15:40
*** ramishra has joined #openstack-infra15:40
*** ifarkas is now known as ifarkas_afk15:40
mgagneok, I upgraded all deps to latest and issue is now gone with nodepool. thanks for the help15:40
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Record testenv wait times in ovb jobs  https://review.openstack.org/34703715:41
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Don't spam postci with deployment time loop  https://review.openstack.org/34699015:41
pabelangerrcarrillocruz: I tried clicking on your link: https://www.openstack.org/summit/barcelona-2016/vote-for-speakers/presentation/15433 but didn't take me to your talk15:42
pabelangerrcarrillocruz: I think something is up with the summit site15:42
rcarrillocruzyeah15:42
rcarrillocruzdescriptions are missing15:42
rcarrillocruzlinks are broken15:42
pabelangeryup15:42
*** tesseract- has quit IRC15:43
jbernardit looks like ceph is failing a bit more than it should, ill try to look into this today, just fyi15:43
fungicorvus: yipes. i'll spread the word they might want to do a followup15:43
anteayapabelanger: rcarrillocruz please add your comments to https://bugs.launchpad.net/openstack-org/+bug/160660315:44
openstackLaunchpad bug 1606603 in openstack-org "Can't see the abstract part of votes for summit talks " [Critical,Fix released]15:44
rcarrillocruzplease do, as i misunderstood and thought you were looking for someone to look at it15:45
rcarrillocruzi have other stuff ongoing, so go ahead15:45
*** weshay is now known as weshay_brb15:45
pabelangeranteaya: thank you for the link15:46
anteayapabelanger: you are welcome15:46
fungicorvus: reading that announcement now, it looks sane to me (says "voting closes blah blah... unique urls to abstracts... track chairs decide... et cetera)15:46
anteayapabelanger: I'm told the abstract issue has been resolved, I don't know if other issues are outstanding15:46
fungicorvus: assuming you mean the one to the mailing lists?15:46
fungifrom erin?15:47
fungicorvus: or did you get a separate direct one as a potential speaker?15:47
corvusfungi: direct15:47
fungicorvus: oh, yep, i did too15:47
*** oanson has joined #openstack-infra15:47
fungicorvus: yeah, that's an unfortunate message. i'll give them a heads up15:48
*** andreas_s has quit IRC15:48
*** abregman has quit IRC15:49
*** atom_ has quit IRC15:49
*** PollyZ has quit IRC15:49
mgagnelooks like you can't directly link to a talk. the URL redirects you to the first talk15:50
anteayamgagne: can you add to this? https://bugs.launchpad.net/openstack-org/+bug/160660315:51
openstackLaunchpad bug 1606603 in openstack-org "Can't see the abstract part of votes for summit talks " [Critical,Fix released]15:51
anteayamgagne: or start a new bug15:51
mgagneWill open a new bug, mine is unrelated15:51
*** javeriak has joined #openstack-infra15:53
anteayamgagne: sounds good15:53
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add facter output to host_info.log  https://review.openstack.org/34746015:55
zigofungi: Would you have time to review this? https://review.openstack.org/34609515:55
*** xenogear_ has quit IRC15:55
*** PollyZ has joined #openstack-infra15:55
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Implement undercloud upgrade job - Mitaka -> Newton  https://review.openstack.org/34699515:55
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add facter output to host_info.txt  https://review.openstack.org/34746015:55
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Implement undercloud upgrade job - Mitaka -> Newton  https://review.openstack.org/34699515:56
*** weshay_brb is now known as weshay15:56
*** mriedem1 has joined #openstack-infra15:57
rcarrillocruzcorvus: re: your job auth comments. Even if we just implement 'password' and 'swift-tmpurl', you think i should at least put the 'swift' and 'afs' on the schema and parser code? or i just leave it for now?15:58
*** sdague has quit IRC15:58
openstackgerritMerged openstack-infra/project-config: Run openstack ansible jobs on trusty  https://review.openstack.org/34744015:58
*** mriedem has quit IRC15:59
*** trown is now known as trown|lunch15:59
*** Apsu has left #openstack-infra15:59
*** mriedem1 is now known as mriedem16:00
corvusrcarrillocruz: i'd leave it for now16:00
rcarrillocruzk16:00
*** sdague has joined #openstack-infra16:00
fungicorvus: apparently they have to update the text/plain and text/html versions of their mass mailing templates separately, and updated only the text/html one. they'16:01
fungire working on a follow-up now it sounds like16:01
*** jimbaker` has joined #openstack-infra16:02
mgagneanteaya: removal of link was done on purpose based on feedback from the community according to the announcement.16:02
corvusfungi: aha16:02
*** jimbaker` is now known as jimbaker16:03
*** jimbaker has quit IRC16:03
*** jimbaker has joined #openstack-infra16:03
anteayamgagne: how interesting16:03
*** oanson has quit IRC16:03
*** esikachev has quit IRC16:04
mgagneanteaya: yea... I happen to disagree with the measure and will open a bug anyway.16:04
anteayayeah, I think being able to link directly to the talk you want to link to is kind of important16:04
*** pgadiya has joined #openstack-infra16:04
anteayaI wonder who in the community felt it was detrimental to do so16:04
*** pgadiya has quit IRC16:05
anteayanow I do disagree with the wave of "vote for me" spam16:05
mgagneanteaya: it was done to counter vote gaming. but I feel this is an inconvenience the end user shouldn't have to deal with.16:05
anteayabut I think there are other ways to address it than sending all traffic to one talk16:05
anteayaand it won't counter vote gaming16:05
*** jlanoux has quit IRC16:05
*** jsavak has quit IRC16:05
anteayabut we can pretty much guarentee their selected talk will get a slot at the summit16:06
mgagneanyway, we found the reason for the "bug"16:06
anteayaso we did16:06
*** jsavak has joined #openstack-infra16:06
*** nmagnezi has joined #openstack-infra16:08
*** PollyZ has quit IRC16:10
*** asettle has quit IRC16:11
fungimgagne: anteaya: right, the main reason it was removed was to make it harder for prospective speakers and their fanbase to twitterspam "vote for me!" links to their talk abstracts16:11
*** mikelk has quit IRC16:12
fungimgagne: anteaya: not so much to counter vote gaming, as to reduce nuisance spamming within and from our community16:12
anteayasure16:13
anteayabut why now send all traffic to one selected talk?16:13
krotscheckfungi: You're not going to stop the spamming. You're just going to increase frustration with the UI, which makes the foundation look incompetent.16:13
pabelangercorvus: looks like we also need to setup the control_path in ansible: http://docs.ansible.com/ansible/intro_configuration.html#control-path.  zlstatic01.o.o is still creating that in /home/jenkins/.ansible/cp so there is potential for files to leak into $HOME again16:13
anteayawhy not send to a general index page?16:13
fungithe voting furor around each summit has started to become a public image problem for openstack16:13
anteayafungi: I agree it is a problem16:14
*** Ahharu has joined #openstack-infra16:14
Ahharuhey16:14
anteayaand for me the source of the problem is folks not commiting to the intent for which openstack stands16:14
fungiideally the voting would just go away, but removing direct links for the abstracts was seen as a compromise to satisfy the part of the community who seemed to think it was essential to still have a "vote"16:14
Ahharuit seems zuul is having problems again16:14
Ahharuhttp://status.openstack.org/zuul/16:14
anteayaAhharu: again, or still?16:14
Ahharui think.. again16:15
pabelangerno problems from what I see, just under load16:15
*** oanson has joined #openstack-infra16:15
anteayaAhharu: it is still working through the backlog from yesterday when I looked16:15
fungiAhharu: it looks fine to me?16:15
anteayapabelanger: yeah, that is what I assessed as well16:15
fungiseems to be churning through ~1k jobs an hour righth now16:15
anteayaso folks paying lip service to open, then directing employees to vote a certain way is a problem16:16
anteayaand the manifestation is gamed voting16:16
corvuspabelanger: well, that's just on the launchers, right?16:16
anteayabut gamed voting isn't the source of the problem16:16
pabelangerwe're down to about ~500 max nodes these days, so the backlog is larger compared to previous months16:16
pabelangercorvus: yes16:16
AhharuI see jobs on post step there with 30+ hours queued still and I got a puppet-lint peding for 2 hours16:16
corvuspabelanger: are they leaking?16:16
pabelangercorvus: yes, you can see zlstatic01.o.o is still creating files in /home/zuul/.ansible16:17
corvuspabelanger: creating isn't leaking16:17
*** savihou has quit IRC16:17
*** PollyZ has joined #openstack-infra16:18
corvuspabelanger: i see zero files in /home/zuul/.ansible/cp on zlstatic0116:18
*** liusheng has quit IRC16:18
pabelangercorvus: actually, good point. I don't think they would leak on static workers, since the nodes are using the same name16:18
pabelangerlet me upgrade zl01.o.o16:18
*** adrian_otto1 has joined #openstack-infra16:18
corvuspabelanger: all of the /home/zuul/.ansible/cp files on zl01 are from today, within the last few hours16:18
zaromorning16:19
*** shashank_hegde has joined #openstack-infra16:19
*** adrian_otto1 is now known as adrian_otto16:19
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Run bindep project-config test for all distro  https://review.openstack.org/34747316:19
AJaegerclarkb: the above is needed as well AFAIK ^16:19
pabelangercorvus: okay, so maybe leaking is not the issue in this case16:19
clarkbAJaeger: thanks16:19
*** yamamoto has joined #openstack-infra16:20
pabelangercorvus: sorry for the noise16:20
clarkbAJaeger: I went ahead and fast approved it. since you are right16:20
*** piet_ has quit IRC16:20
pabelangerAhharu: yes, it will eventually clear, just taking time16:21
anteayamorning zaro16:21
*** gyee has joined #openstack-infra16:21
AJaegerthanks, clarkb . Could you also review https://review.openstack.org/347147 , please?16:23
*** Sukhdev has joined #openstack-infra16:23
clarkbAJaeger: done one suggestion but looks fine otherwise16:25
openstackgerritKhai Do proposed openstack-infra/system-config: Configure its-storyboard plugin  https://review.openstack.org/33092516:25
*** shashank_hegde has quit IRC16:25
fungianteaya: in actuality, vote gaming is not a problem for this... the track chairs are free to completely disregard votes (and many do, and many more only take them with a grain of salt and base their decisions on other more reasonable factors)16:26
anteayaagreed on what I did as track chairs and what I assume others do as well16:26
anteayachair*16:27
corvuspabelanger: np -- it's worth thinking through :)16:27
*** yamamoto has quit IRC16:27
sulohi, if anyone has some time https://review.openstack.org/#/c/345453/ please :)16:27
*** piet_ has joined #openstack-infra16:27
anteaya<-- offline for a bit16:28
corvusfungi, anteaya: i think we should only vote on things where it counts16:28
anteayacorvus: I agree16:28
anteayasham voting is worse than no voting at all16:28
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Implement undercloud upgrade job - Mitaka -> Newton  https://review.openstack.org/34699516:28
corvusyep16:28
openstackgerritKhai Do proposed openstack-infra/system-config: Configure its-storyboard plugin  https://review.openstack.org/33092516:29
*** dizquierdo has quit IRC16:29
AJaegerclarkb: the jobs use python-jobs - how do you propose to clean that up?16:30
*** derekh has quit IRC16:30
clarkbAJaeger: for the one is it just using pep8?16:30
*** caowei has quit IRC16:30
AJaegeryeah, could change that - let me do that...16:31
clarkbif so we could reduce to that16:31
*** john-davidge has quit IRC16:31
clarkbAJaeger: just trying to keep job count down as much as possible as that may affect gearman16:33
*** jpich has quit IRC16:35
EmilienMI am wondering if OS infra also hits this problem : https://bugs.launchpad.net/tripleo/+bug/160652916:35
openstackLaunchpad bug 1606529 in tripleo "tripleo-ci multinode: undercloud install sometimes fails with Error: Could not run: Could not retrieve facts for <hostname>.local: no address for <hostname>.local" [High,In progress] - Assigned to James Slagle (james-slagle)16:35
EmilienMthis bug happens on some clouds only16:35
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove unused trusty jobs  https://review.openstack.org/34714716:35
AJaegerclarkb: yeah, I agree. done ^16:36
clarkbEmilienM: we dont run facter in all the clouds anymore so likely we avoid it. But I am guessing its related to info missing from /etc/hosts16:36
fungizigo: on 346095, i don't understand why you need us building backports of random packages from sid to jessie so that you can build your packages. if you're targeting inclusion of your packages in jessie-backports then won't their dependencies already need to be in jessie-backports anyway?16:37
*** rwsu has joined #openstack-infra16:37
EmilienMslagle: I guess we'll need to hack something in our scripts to override /etc/hosts16:37
clarkbEmilienM: possibly some clouds setting dns domain via dhcp and others not and glean only handling the case where dhcp doesnt set it16:37
*** tqtran has joined #openstack-infra16:37
*** rbuzatu has quit IRC16:37
EmilienMclarkb: right16:37
*** chem` has joined #openstack-infra16:37
*** chem has quit IRC16:37
pabelangerEmilienM: would using --certname centos-7-2-node-ovh-bhs1-2919288 work on your puppet apply command?16:39
*** tqtran_ has joined #openstack-infra16:39
EmilienMpabelanger: not sure16:39
pabelangerI tend to use --certname locally to avoid DNS issues16:39
slagleEmilienM: we could also try setting the hostname in undercloud.conf16:39
EmilienMslagle: it sounds like it's /etc/hostname not /etc/hosts16:39
slagleEmilienM: undercloud_hostname16:40
*** KaitoDaumoto has joined #openstack-infra16:40
slaglewe could try setting that16:40
EmilienMslagle: we do it for ovb16:41
EmilienMslagle: in toci_instack_ovb.sh16:41
clarkbhostname should be set by glean properly16:41
*** tqtran has quit IRC16:41
*** florianf has quit IRC16:42
*** rbuzatu has joined #openstack-infra16:43
*** lucasagomes is now known as lucas-dinner16:44
*** yamahata has quit IRC16:44
*** tphummel has joined #openstack-infra16:45
*** dmsimard|afk is now known as dmsimard16:47
*** rbuzatu has quit IRC16:48
mgagneis there a way to manually trigger a periodic job in Zuul?16:48
*** Sukhdev has quit IRC16:48
*** itisha has joined #openstack-infra16:48
openstackgerritKhai Do proposed openstack-infra/system-config: Install its-storyboard plugin on review-dev.o.o  https://review.openstack.org/34060516:48
*** baoli_ has quit IRC16:49
*** ccamacho is now known as ccamacho|awawawa16:50
pabelangermgagne: yes, you can use the zuul client to do it: http://docs.openstack.org/infra/zuul/client.html#zuul-client16:50
*** ccamacho|awawawa is now known as ccamacho|away16:50
mgagnepabelanger: thanks I'm looking for the syntax =)16:50
openstackgerritKhai Do proposed openstack-infra/system-config: Install its-storyboard plugin on review-dev.o.o  https://review.openstack.org/34060516:50
mgagnebecause --change is required and AFAIK, periodic jobs don't have change ID16:52
pabelangermgagne: enqueue-ref16:52
mgagnecool will test right now16:53
openstackgerritKhai Do proposed openstack-infra/system-config: Install its-storyboard plugin on review.o.o  https://review.openstack.org/34748616:54
*** Apoorva has joined #openstack-infra16:55
openstackgerritJames E. Blair proposed openstack/gertty: Merge branch 'stable/1.3'  https://review.openstack.org/34748716:56
openstackgerritMerged openstack/gertty: Merge branch 'stable/1.3'  https://review.openstack.org/34748716:57
mgagnepabelanger: what should be --newrev?16:57
odyssey4meheh, clarkb pabelanger now we have both xenial and trusty docs jobs running :p16:57
openstackgerritMerged openstack-infra/project-config: Run bindep project-config test for all distro  https://review.openstack.org/34747316:57
*** Na3iL has quit IRC16:58
pabelangermgagne: you could use 0000000 or some other value16:58
fungipabelanger: mgagne: or the branch name16:58
pabelangerfungi: ah, good idea16:58
fungithough periodic jobs are effectively branchless16:58
AJaegerEmilienM: could you review https://review.openstack.org/#/c/347348 , please?16:58
openstackgerritKhai Do proposed openstack-infra/system-config: Add storyboard task to Gerrit tracking id  https://review.openstack.org/34451916:59
AJaegerodyssey4me: lucky you;(16:59
*** armax has quit IRC16:59
*** jsavak has quit IRC16:59
fungisince zuul only takes the branch name from the gerrit trigger, not the periodic trigger16:59
odyssey4meAJaeger well, it's not terrible... but it is a waste of nodes16:59
AJaegeragreed16:59
openstackgerritMerged openstack/gertty: Add Gentoo install instructions  https://review.openstack.org/31466417:00
*** rbuzatu has joined #openstack-infra17:00
clarkbodyssey4me: so regex needs tightening. is that the only one running on both that shouldnt be?17:00
*** ddieterly is now known as ddieterly[away]17:00
*** shashank_hegde has joined #openstack-infra17:00
odyssey4meclarkb yeah, that's all I see for now17:01
*** nmagnezi has quit IRC17:01
*** Swami has joined #openstack-infra17:01
EmilienMAJaeger: oh thanks, patch is not correct17:02
*** netsinn has joined #openstack-infra17:02
AJaegerEmilienM: thanks for confirming my suspicion17:03
openstackgerritMerged openstack/gertty: Add support for the projects search term  https://review.openstack.org/32412217:03
AJaegerodyssey4me: which jobs should really match? The func ones?17:03
AJaegerodyssey4me: gate-{name}-ansible-func-ubuntu-trusty and gate-{name}-ansible-func-ubuntu-trusty-nv?17:03
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Implement undercloud upgrade job - Mitaka -> Newton  https://review.openstack.org/34699517:03
odyssey4meAJaeger yeah, but func could be anything because it's {scenario} which is a tox target17:04
*** rdx_matt has quit IRC17:04
*** rdx_matt has joined #openstack-infra17:04
clarkbAJaeger: odyssey4me its probably better to just have a not docs negative lookahead match17:05
AJaegerclarkb: ok. Was trying to check for a positive case ;)17:06
AJaegerclarkb, odyssey4me : Who will fix it?17:06
mgagnezuul enqueue-ref doesn't seem to work with those arguments: http://paste.openstack.org/show/542149/17:07
*** markus_z has joined #openstack-infra17:07
odyssey4meI'm happy to put up a patch, but I'm likely to get it wrong first time.17:07
odyssey4melemme have a go at it17:07
*** adrian_otto has quit IRC17:07
clarkbAJaeger: odyssey4me ^gate-openstack-ansible-(?!docs).*-ubuntu-trusty.*$ is the regex we want I think17:07
markus_zclarkb: logstash is a bit lazy today, can you poke it a little?17:08
odyssey4mehaha, incoming patch17:08
*** netsinn is now known as jiggalator17:08
markus_zhttp://graphite.openstack.org/render/?from=-24hours&height=180&until=now&width=334&bgcolor=ffffff&fgcolor=000000&target=color(alias(stats.gauges.logstash.geard.queue.running,%20%27Running%27),%20%27blue%27)&target=color(alias(stats.gauges.logstash.geard.queue.waiting,%20%27Waiting%27),%20%27red%27)&target=color(alias(stats.gauges.logstash.geard.queue.total,%20%27Total%20Jobs%27),%20%27888888%27)&target=color(alias(stats.gauges.logst17:08
markus_zash.geard.workers,%20%27Workers%27),%20%27green%27)&title=Logstash%20Job%20Queue&_t=0.15027700675842903#146955287009517:08
*** kzaitsev_mb has joined #openstack-infra17:08
clarkbAJaeger: odyssey4me local testing in python interpreter seems to show that matches the func jobs but not docs so I got the negative lookahead correct17:08
markus_zwhops, that was not was I wanted17:08
AJaegergreat! Let's wait for patch and test results then to double check17:08
corvusmgagne: the 'trigger-job.py' script in the tools/ directory of the zuul source may be useful17:09
mgagnewill check that one thanks!17:09
*** rdx_matt has quit IRC17:09
corvusmgagne: it bypasses zuul and submits directly to the gearman queue17:09
*** jascott1 has joined #openstack-infra17:09
clarkbmarkus_z: ya I think we may have gotten i mad when we threw all these jobs at it17:09
corvusmgagne: so it will run the job, but zuul won't know about it, and won't report it or anything17:09
mgagnehmm17:10
*** jtomasek has quit IRC17:10
*** amitgandhinz has quit IRC17:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Tighten the trusty job filter for OpenStack-Ansible  https://review.openstack.org/34748917:10
odyssey4meAJaeger clarkb ^17:10
mgagnewill make sur eto check on slaves17:10
clarkbodyssey4me: AJaeger re.match(b'^gate-openstack-ansible-(?!docs).*-ubuntu-trusty.*$', 'gate-openstack-ansible-docs-ubuntu-trusty') if you want to test it yourself17:11
*** PollyZ has quit IRC17:12
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Set undercloud_hostname in multinode jobs  https://review.openstack.org/34749017:12
*** shardy has quit IRC17:13
clarkbmarkus_z: I will dig in in a few17:13
clarkbstill catching up on the rest of my morning17:13
*** mhickey has quit IRC17:14
markus_zclarkb: sure, no rush17:14
*** trown|lunch is now known as trown17:14
clarkbI need to try and do yardwork before it gets hot outside.17:15
*** sarob has joined #openstack-infra17:16
mgagnecorvus: it worked. I used following arguments: https://gist.github.com/mgagne/bac35c0047b67d52f0add69fa38a2eea17:17
mgagnewell not :D17:17
*** shashank_hegde has quit IRC17:17
openstackgerritsulochan-acharya proposed openstack-infra/project-config: Enable zuul jobs for craton and cratonclient  https://review.openstack.org/34545317:18
*** acoles is now known as acoles_17:20
openstackgerritAndrey Nikitin proposed openstack-infra/puppet-gerrit: Order of the classes parameters is refactored  https://review.openstack.org/29472817:20
mgagne--newrev refs/heads/master works17:21
*** netsinn has joined #openstack-infra17:21
HeOSyolanda, hello! If you have a free time, could you please review again the following request: https://review.openstack.org/#/c/294728/ ? :)17:22
openstackgerritsulochan-acharya proposed openstack-infra/project-config: Enable zuul jobs for craton and cratonclient  https://review.openstack.org/34545317:23
openstackgerritMerged openstack/gertty: Add user email addresses to the change view  https://review.openstack.org/32778517:23
openstackgerritMerged openstack/gertty: Fix "too many SQL variables" error  https://review.openstack.org/33358317:23
openstackgerritMerged openstack/gertty: Speed up loading a change with eager loading  https://review.openstack.org/34391917:23
openstackgerritMerged openstack/gertty: Make unified diffs group changed lines  https://review.openstack.org/31592717:23
openstackgerritMerged openstack/gertty: Prevent more than one gertty from running at a time  https://review.openstack.org/32858317:23
openstackgerritMerged openstack/gertty: Add new lock-file setting to the config doc and reference config  https://review.openstack.org/34570417:23
*** liusheng has joined #openstack-infra17:23
*** Jeffrey4l has quit IRC17:24
openstackgerritMerged openstack-infra/project-config: Run tripleo-ci-centos-7-nonha-multinode in Heat's experimental pipeline  https://review.openstack.org/34701217:24
*** jsavak has joined #openstack-infra17:24
*** sandanar_ has quit IRC17:25
*** yamahata has joined #openstack-infra17:27
*** chem` is now known as chem17:29
*** asettle has joined #openstack-infra17:30
mgagnecorvus: it looks like trigger-job.py doesn't send the OFFLINE_NODE_WHEN_COMPLETE parameter. Is it only a matter of adding it to the data sent to gearman?17:30
openstackgerritAndrey Nikitin proposed openstack-infra/puppet-jenkins: Order of the classes parameters is refactored  https://review.openstack.org/29517117:31
*** netsinn has quit IRC17:31
*** kzaitsev_mb has quit IRC17:31
*** osnexus has joined #openstack-infra17:32
openstackgerritMerged openstack-infra/tripleo-ci: Remove sahara and cinder packaged symlinks in postci  https://review.openstack.org/34722817:32
*** netsinn has joined #openstack-infra17:32
corvusmgagne: yeah, we never use it for nodes we want to offline.  but it's just a regular job parameter.17:34
mgagneok thanks!17:34
corvusmgagne: i'm assuming you're in an exceptional situation and you just need some jobs to run once :)17:34
mgagneyea, the equivalent of update requirements which happens to run on ephemeral nodes17:34
corvusmgagne: if you're engineering some regular thing, we should talk more about what you need :)17:34
mgagneand since we revoke sudo too, next job fails due to lack of sudo =)17:35
corvusmgagne: gotcha17:35
mgagnewe just wanted to get the periodic run now instead of later17:35
mgagne(thanks to json_pure 2.0.2)17:36
*** sdake_ is now known as sdake17:37
openstackgerritAlexey Ovchinnikov proposed openstack-infra/project-config: [Manila] Add services to minimal-dsvm job  https://review.openstack.org/34718017:37
*** jiggalator is now known as Guest765117:38
openstackgerritMerged openstack/gertty: Display gate results ordered  https://review.openstack.org/33452417:40
openstackgerritAndrey Nikitin proposed openstack-infra/puppet-nodepool: Order of the classes parameters is refactored  https://review.openstack.org/29528517:42
*** Sukhdev has joined #openstack-infra17:42
*** kushal has quit IRC17:42
*** piet_ has quit IRC17:44
*** piet_ has joined #openstack-infra17:45
openstackgerritAndrey Nikitin proposed openstack-infra/puppet-openstack_health: Order of the classes parameters is refactored  https://review.openstack.org/29529017:45
*** electrofelix has quit IRC17:46
*** baoli has joined #openstack-infra17:46
*** ihrachys has quit IRC17:47
*** netsinn is now known as nis1017:47
*** nis10 is now known as netsinn17:48
*** netsinn has quit IRC17:48
*** cody-somerville has joined #openstack-infra17:48
*** cody-somerville has joined #openstack-infra17:48
*** netsinn has joined #openstack-infra17:48
*** jiggangalator has joined #openstack-infra17:49
*** csomerville has quit IRC17:49
*** Sukhdev has quit IRC17:50
*** jiggangalator has quit IRC17:50
*** cody-somerville has quit IRC17:50
dhellmannfungi : I'm seeing some odd behavior on the release tagging job that makes me think maybe the scripts are out of date.17:51
*** Sukhdev has joined #openstack-infra17:51
dhellmannfungi : the log http://logs.openstack.org/47/47db07d793e5eb5dc6b77a6af11d0acc7d641ea9/release-post/tag-releases/9adf497/console.html shows the job running for a repo that should be skipped by the script, but instead of the "skipping" message it appears to try to clone the repo, and fails17:51
openstackgerritMerged openstack-infra/project-config: Tighten the trusty job filter for OpenStack-Ansible  https://review.openstack.org/34748917:52
dhellmannfungi : the clone command output used to be hidden, but that was changed last week when this job started failing as a way to try to debug it17:52
*** tonytan4ever has quit IRC17:53
*** tosky has quit IRC17:53
*** nwkarsten has joined #openstack-infra17:53
*** netsinn is now known as jiggalator17:54
openstackgerritAndrey Nikitin proposed openstack-infra/puppet-openstackci: Order of the classes parameters is refactored  https://review.openstack.org/29530917:55
*** pvaneck has joined #openstack-infra17:55
openstackgerritAndrey Nikitin proposed openstack-infra/jeepyb: Update mechanism of creating groups in database and managing access rights with jeepyb  https://review.openstack.org/28484317:55
*** degorenko is now known as _degorenko|afk17:55
*** priteau has joined #openstack-infra17:57
*** jiggalator is now known as netsin_17:57
*** moravec has quit IRC17:58
*** moravec has joined #openstack-infra17:59
*** asettle has quit IRC17:59
*** salv-orlando has quit IRC18:00
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Remove EPEL usage  https://review.openstack.org/34749918:00
*** ddieterly[away] has quit IRC18:00
*** jpr has joined #openstack-infra18:01
*** shashank_hegde has joined #openstack-infra18:02
*** amitgandhinz has joined #openstack-infra18:02
*** cgalan has quit IRC18:02
openstackgerritAndrey Nikitin proposed openstack-infra/puppet-zuul: Order of the classes parameters is refactored  https://review.openstack.org/29538518:03
*** jimbaker has quit IRC18:03
*** salv-orlando has joined #openstack-infra18:04
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/zuul: Add initial support for jobs authentication config  https://review.openstack.org/34691418:04
*** rdx_matt has joined #openstack-infra18:05
*** rdx_matt has quit IRC18:05
*** rdx_matt has joined #openstack-infra18:05
*** mriedem1 has joined #openstack-infra18:06
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Don't deploy net-iso env when we won't use it  https://review.openstack.org/34750318:06
*** mriedem has quit IRC18:07
*** mriedem1 is now known as mriedem18:07
openstackgerritMerged openstack-infra/irc-meetings: Update agenda for SWG Meeting  https://review.openstack.org/34743818:08
jlkFYI the blue box cloud MontyTaylor will be getting upgraded to mitaka today.18:08
jlkthere should be minimal disruption during this upgrade18:09
anteayajlk: do you think we should shut off nodes in nodepool?18:10
jlkShouldn't be necessary18:10
anteayaokay, thanks for the heads up18:11
jlkthe various APIs may become responsive for a few seconds during the upgrade, but dataplane will continue to function18:11
anteayainfra-root^^18:11
anteayavery good18:11
*** liusheng has quit IRC18:11
mordredjlk: awesome! thanks18:11
pabelangernice!18:12
jlkIf you see my IRC client suddenly leave, its probably because the cloud blew up and I was fired.18:12
pleia2hah18:12
anteayajlk: okey dokey18:12
mordredjlk: good luck with that18:13
jlkI hear it's possible to be fired from IBM, it just takes some serious effort. Actually kind of sounds like a fun achievement to shoot for18:14
anteayaone for the trophy shelf18:14
*** netsin_ is now known as jiggalator18:15
*** jimbaker has joined #openstack-infra18:15
*** jimbaker has joined #openstack-infra18:16
*** adrian_otto has joined #openstack-infra18:16
*** inc0 has quit IRC18:17
*** esikachev has joined #openstack-infra18:17
jlkactually I'm rather interested to see how this upgrade impacts nodepool and whatnot. Grabbing some chart screenshots after the upgrade would make for a nice blog post18:17
*** ramishra has quit IRC18:18
fungianteaya: jlk: thanks! we're not actually using it (and haven't been for months)18:19
mordredjlk: I'm very curious how it affects the fip timeout problem18:19
fungiwaiting for the upgrade18:19
mordredjlk: although we have a new workaround for that in shade now18:19
fungiwe didn't want to turn it back on unti there was a new shade fix and the upgrade was done18:19
fungiso fingers crossed!18:19
*** ivyyy has joined #openstack-infra18:19
*** kzaitsev_mb has joined #openstack-infra18:19
jlkah okay18:19
*** cody-somerville has joined #openstack-infra18:19
anteayafungi: ah, thanks, I didn't go so far as to check the file18:20
*** rbuzatu has quit IRC18:20
clarkb11am is already too hot for yard work. Not sure how people in texas survive18:20
*** ramishra has joined #openstack-infra18:20
anteayaclarkb: move elsewhere?18:20
*** liusheng has joined #openstack-infra18:20
*** cody-somerville has quit IRC18:20
* anteaya suggesting that is how folks in texas survive18:20
jlkTexas is dumb18:20
anteayaI can go as far as texas is hot with you18:21
pleia2I had to put a hoodie on at a baseball came last night, it was cold, woo microclimate18:21
anteayadid you enjoy the ball game?18:22
pleia2yes :) we lost, but it was nice to get outside, and I caught a bunch of pokemon18:22
*** rbuzatu has joined #openstack-infra18:22
*** ociuhandu has quit IRC18:22
openstackgerritClark Boylan proposed openstack-infra/project-config: Run coverage jobs on xenial  https://review.openstack.org/34698718:22
clarkbanteaya: pabelanger AJaeger ^ now with less merge conflict18:23
openstackgerritTony Breeds proposed openstack-infra/project-config: Remove the check tox env from irc-meetings  https://review.openstack.org/34751018:23
openstackgerritTony Breeds proposed openstack-infra/irc-meetings: Check chairs are in the 'correct' format as part of pep8  https://review.openstack.org/34751118:23
openstackgerritTony Breeds proposed openstack-infra/irc-meetings: Remoce the check target  https://review.openstack.org/34751218:23
mordredclarkb, anteaya: it's 13:23 in Texas and it's almost warm enough to get into the pool18:23
clarkbmordred: my local wunderground station says 72F18:24
anteayayay less merge conflict18:24
*** esikachev has quit IRC18:24
*** bin_ has quit IRC18:24
mordredmine says 90.718:24
anteayamordred: almost18:24
pabelangerclarkb: +218:24
clarkbanteaya: pabelanger https://review.openstack.org/#/c/347147/3 is another related change from AJaeger18:25
pabelangerlooking18:25
mordredanteaya: yeah. well, I could likely swim anyway since the pool water is finally resting at around 91 - so I won't get colds18:25
*** inc0 has joined #openstack-infra18:26
corvusif you've ever wondered how people choose to be A's or Giants fans -- its not really about the teams, it's about whether you want to wear a hoodie or sunglasses to baseball games18:26
inc0howdy folks18:26
corvuspleia2: ^ :)18:26
openstackgerritJohn Trowbridge proposed openstack/diskimage-builder: Remove EPEL as hardcoded dependency of centos7 element  https://review.openstack.org/34751318:26
mordredalthough pleia2 has reminded me that I'm going ot need to pack a coat for my SF trip18:26
mordredcorvus: ++18:26
inc0sooo....infra cluster we're deploying18:26
anteayaand away it goes18:26
*** jiggalator has quit IRC18:26
* anteaya crosses her fingers18:26
*** rbuzatu has quit IRC18:27
pleia2corvus: haha18:27
anteayamordred: that is soup18:27
clarkbanteaya: pabelanger going to attempt to start the dsvm/tempest switchover change today after meetings. This is assuming I don't have to take kid to doctor (its a long story tl;dr parenting is fun)18:27
mordredanteaya: it's very pleasing18:27
anteayacorvus: ha ha ha18:27
pleia2mordred: and yeah, it's been on the chilly side here in the city, july you know18:28
anteayaclarkb: good health to your family, ack on dsvm/tempest large patch expected18:28
clarkbpleia2: you'll like our local team. The Hillsboro Hops18:28
mordredpleia2: oh my. just looked at the weather ... I'm going to need to pack probably a hoodie AND a jacket AND wear shoes18:28
pleia2clarkb: nice18:28
anteayamordred: well I played waterpolo in university, was in the pool about 8 times a week18:28
pleia2mordred: yeah18:28
inc0you guys need public ipv6 addresses on vms, ipv4 for API access...anything else?18:28
inc0fungi, ^18:28
pabelangerinc0: don't leave us hanging :D18:28
anteayamordred: I learned that when you sweat in water the sweat stays on you18:28
anteayamordred: it wasn't pleasant18:29
mordredanteaya: it is very hard for it to evaporate in 100% humidity18:29
clarkbinc0: more specifically we need publicly routable ip addrs. ipv6 is one way to do that.18:29
anteayamordred: hence not a fan of swiming in hot watter18:29
mgagneanteaya: looks like removing links didn't deter people from promoting their talks: https://twitter.com/ossarchitect/status/75798857526677913618:29
anteayamordred: indeed, you grasp the science of it quickly18:29
anteayamgagne: I didn't think it would18:29
clarkbinc0: we should be able to manage ipv6 access to the apis as well but maybe I missed something and that isn't the case18:29
mordredanteaya: I'm not a fan of swimming in hot water - but 91 isn't hot - it's still cooler than skin temperature ... 91 just isn't freezing cold like 80 is18:29
corvusmordred: if you forgot your coat, you'll have to buy one of these at the airport and look like a tourist: http://qph.cf.quoracdn.net/main-qimg-2d4c8d957ea3ed4f07eac471dcb3fd2918:29
fungiinc0: we also need at least one instance with a reachable ipv4 address since our mirror servers rely on the afs protocol which currently lacks provisions for ipv618:29
mordredcorvus: :)18:29
mordredcorvus: I'll bring my coat18:30
anteayamordred: I'm still not with you at 80 is freezing18:30
*** kzaitsev_mb has quit IRC18:30
clarkbfungi: oh right afs can't ipv618:30
mordredanteaya: well, I get chilled in 80 degree water18:30
*** esikachev has joined #openstack-infra18:30
mordredanteaya: so maybe not "freezing" ... but my teeth will eventually start chattering18:30
*** adrian_otto has quit IRC18:30
anteayamordred: okay, you have about 2 weeks at best to swim in Canada18:30
fungiinc0: generally we'd prefer two tenants in total, one where we put the mirror server and one we point nodepool at to manage for us18:30
anteayathat is excepting the yukon18:30
clarkbmordred: anteaya http://www.seatemperature.org/australia-pacific/micronesia/pohnpei/ I am with mordred on 80F is cold18:30
pleia2tourist coat represent http://princessleia.com/images/vacation/sf/lyz_fishermans_wharf.jpg (oh, I was so young and thin there!)18:31
mordredanteaya: yes. this is one of the main reasons that we really can't relocate there in case of political upheaval18:31
anteayaclarkb: wow18:31
mordredclarkb: ++18:31
clarkbI don't even get in the water in hawaii18:31
anteayamordred: I can see your case for spain18:31
mordredthe water is cold in hawaii18:31
anteayaha ha ha18:31
anteayaha ha ha18:31
anteayapleia2: nice tourist coat18:32
pleia2that picture is after spending all day in Sonoma, where it was like 80 degrees18:32
anteayapleia2: I'm desounding an install of xenial18:32
mordredanteaya: to be fair, spain is still colder than I'd like, but it's as close as I can get in a country that's somewhat politically stable and non-repressive18:32
anteayapleia2: my usual mode is to delete all the ubuntu sounds in /usr/share/sounds18:32
pleia2anteaya: desounding?18:32
pleia2ah, is it noisy?18:32
anteayapleia2: is there a different way18:32
mordredpleia2: that's an awesome tourist coat18:33
anteayapowering on it my business and noone else's18:33
*** PollyZ has joined #openstack-infra18:33
pleia2I use Xubuntu, which I don't think it makes noise18:33
clarkbanteaya: I think you can disable all the desktop sounds in the desktop gui configurators18:33
anteayapleia2: ah18:33
*** markus_z has quit IRC18:33
anteayaclarkb: I have tried in the past and then gotten caught in public, to my embarssment18:33
*** cody-somerville has joined #openstack-infra18:33
anteayaI'll just delete them, then I have confidence18:33
anteayabut thanks18:33
inc0ok, so, 2 tenants, public API access over ipv4, one floating IP for VM with mirrors, network of publicly routable IPv6 for VMs - you need anything else?18:34
inc0floating IP will be ipv418:34
openstackgerritAlexey Ovchinnikov proposed openstack-infra/project-config: [Manila] Add services to minimal-dsvm job  https://review.openstack.org/34718018:34
*** sdake has quit IRC18:35
*** ddieterly has joined #openstack-infra18:35
*** sdake has joined #openstack-infra18:35
*** e0ne has joined #openstack-infra18:36
anteayagood-bye system-ready.ogg18:36
pleia2hehe18:36
openstackgerritMichael Krotscheck proposed openstack-infra/project-config: Added documentation publish jobs for the JavaScript SDK  https://review.openstack.org/34613118:37
*** esikachev has quit IRC18:37
*** dangers_away has left #openstack-infra18:38
*** esikachev has joined #openstack-infra18:39
*** rdx_matt has quit IRC18:39
fungiinc0: a working glance we can upload images into18:39
inc0fungi, working openstack will be there18:39
fungiinc0: though these days that's become a lot more common thankfully18:39
inc0ceph backend even!18:40
fungiheh18:40
inc0sorry18:40
inc0:P18:40
fungiinc0: nothing else comes to mind, aside from the later task of identifying a suitable flavor for the job workers18:40
clarkbif its the same hardware as the other osic stuff we can liekly use the same flavor18:40
clarkbI think its 96GB disk, 4vcpu, 8GB RAM18:40
fungiright. in theory that's easy18:41
*** jiggangalator has joined #openstack-infra18:42
*** tonytan4ever has joined #openstack-infra18:43
openstackgerritBrian Hunter proposed openstack-infra/project-config: make trove scenario tests voting  https://review.openstack.org/34751618:45
anteayamordred: hard to find that temperature/political balance18:45
*** jiggangalator is now known as jiggalator18:46
*** esikachev has quit IRC18:47
*** javeriak has quit IRC18:47
mordredanteaya: extremely18:48
*** Sukhdev has quit IRC18:49
*** shashank_hegde has quit IRC18:49
*** weshay has quit IRC18:49
pleia2I've resigned myself to the fact that I hold no credibility with my conservative family anymore because I live in San Francisco ;)18:49
pleia2we mostly talk about the weather18:49
pleia2and wine18:49
openstackgerritBrian Hunter proposed openstack-infra/project-config: promote trove scenario tests to voting and gating  https://review.openstack.org/34751618:50
inc0fungi, so there is very good chance that you'll get all that by the end of the week18:50
openstackgerritIsaku Yamahata proposed openstack-infra/project-config: networking-odl: add coverage, translation and releasenotes  https://review.openstack.org/34627418:50
openstackgerritIsaku Yamahata proposed openstack-infra/project-config: networking-odl: add more jobs  https://review.openstack.org/34704518:50
pleia2inc0: awesome18:50
fungiinc0: count me excited!18:50
inc0how long would it take for you to start running stuff? Consider our help with that18:50
inc0we also want to get this up and running asap18:51
*** corvus is now known as thecount18:51
thecountONE excited person, HA, HA, HA!18:51
*** thecount is now known as corvus18:51
clarkbinc0: previously its only taken a few hours to get things going, largely depends on whether or not launch script for mirror host is working18:51
*** bhavik has joined #openstack-infra18:51
anteayaclarkb: I had to use the gui to mute one sound, I delete most of the ubuntu sound files but it insisted on playing a noise when I adjusted the volume, so far the gui is the only way I can see to silence it18:51
inc0corvus, https://www.youtube.com/watch?v=B-Wd-Q3F8KM18:51
anteayapleia2: weather and wine is good18:52
*** corvus is now known as thecount18:52
* anteaya sees lightening flash18:52
fungithree! three nicks! ha, ha, ha...18:52
anteayaha ha ha18:52
clarkbthen the other portion of work is running the devstack reproduce.sh script on it a few times in different configs to shake out performance issues if any18:52
inc0clarkb, I'd love to share a tmux on that stuff18:53
inc0as I said, we might need to tear down-rebuild this stuff18:53
clarkbinc0: well performance testing should be a one time deal, assuming you don't regress the perofmrance of your flavors over time (which ahs happened in one cloud :( )18:54
fungiinc0: we have piloted a relatively trivial means of broadcasting console sessions over tcp socket18:54
fungithecount has details18:54
fungihe used it to do an impromptu afs seminar/demo18:54
fungithough if we're fiddling with credentials might want to leave that part to a separate terminal18:55
*** adrian_otto has joined #openstack-infra18:55
mordredclarkb, fungi: I was going to try out rcarrillocruz's ansible stuff when I re-spun the bluebox resources, might be worthwhile to try on inc0's stuff too if there might be rebuilds occasionally?18:55
fungimordred: yep, we expect semi-regular rebuilds (maybe every couple months give or take)18:56
rcarrillocruzthere's even a placeholder resources.yaml on system-config repo18:56
inc0mordred, totally, especially that at some point we'd love to do this stuff outselves18:56
*** sc68cal_ is now known as sc68cal18:57
rcarrillocruzwe could even put inc0 cloud there and put some machinery to have persistent resources deployed there18:57
rcarrillocruzmachinery as 'ansible-playbook cloud_launcher @resources.yaml" in a cron really18:57
*** Teresita-Warrior has quit IRC18:57
mtreinishfungi: I spun up a local instance of the puppet mosquitto and germqtt and just realized 2 things: we'll need to add a gerrit user for germqtt (or I guess we could leach off another existing one) and that we probably want to add some auth to mosquitto18:57
rcarrillocruzmordred: yeah, barcelona will be a bit cold18:57
jheskethMorning18:58
rcarrillocruzi vote for south spain when summit comes back to spain in some years18:58
clarkbmordred: rcarrillocruz I am secretly hoping they hand a completely working tenant then we just have to make a mirror in it :)18:58
*** thecount is now known as corvus18:58
mtreinishbecause right now I set it up with basically the default config and it allows anyone to write to it :)18:58
clarkbmordred: rcarrillocruz I think this method of clouding (eg the public cloud method) is the nicest for users :)18:58
mtreinishwhich while it might be fun to see how long it takes someone to figure that out, it probably isn't the best idea18:58
corvusinc0, fungi: http://amo-probos.org/post/1718:59
rcarrillocruzclarkb: yeah, as a matter of fact the only cloud we had/have with domain admin was bluebox, right?18:59
clarkbrcarrillocruz: and infra cloud for a day18:59
rcarrillocruzlol18:59
anteayamorning jhesketh18:59
rcarrillocruzyeah, *that* cloud18:59
rcarrillocruzit's expected to be cabled this week btw18:59
pabelangerfungi: quick heads up, I am not sure I'll be able to discuss my topic at the meeting today.  If you simply want to skip it today.19:00
rcarrillocruzservers have been racked19:00
fungiit's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour19:00
clarkbrcarrillocruz: cool19:00
pabelangerfungi: I have to step out for a 20mins19:00
fungipabelanger: okay, looks like your topic is toward the end of our agenda anyway19:01
*** sputnik13 has joined #openstack-infra19:01
*** Teresita-Warrior has joined #openstack-infra19:02
*** rockyg has joined #openstack-infra19:02
*** fifieldt has quit IRC19:03
*** yuanying has quit IRC19:03
openstackgerritIsaku Yamahata proposed openstack-infra/project-config: networking-odl: add irc notification  https://review.openstack.org/34752219:04
jlkanteaya: argh, so I'm wrong, and our operations would now like to completely tear down that cloud and rebuild it again (since I told them it was unused) because apparently they made a mistake with the filesystem layout the LAST time they tore it down and rebuilt it.19:07
anteayasound typical19:07
anteayawell fungi says we aren't using it right now anyway19:07
jlkanteaya: clarkb: mordred: after the last rebuild, did you all do any work on it to put back the base level config you needed for nodepool, or is it essneitally untouched?19:07
anteayaI'll double check the file to be sure19:07
jlkfungi: ^^19:07
clarkbjlk: I don't think mordred every got around to credentialling us19:08
clarkbso its likely still untouched but mordred should know19:08
clarkbI think nibalizer may have tried to figure it out too?19:08
anteayawe could change this to -1 I guess: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/nodepool.yaml#n52119:09
*** hasharAway is now known as hashar19:10
*** abregman has joined #openstack-infra19:12
openstackgerritAnita Kuno proposed openstack-infra/project-config: Turn bluebox max servers to -1  https://review.openstack.org/34752519:13
anteayajlk: ^^19:13
*** Na3iL has joined #openstack-infra19:14
*** Sukhdev has joined #openstack-infra19:15
*** sdake has quit IRC19:15
*** jiggangalator has joined #openstack-infra19:15
*** oanson has quit IRC19:15
clarkbbkero: after meeting I will get examples together and we can put a list on an etherpad of things that need to be done19:15
bkeroclarkb: sounds good19:16
*** ddieterly is now known as ddieterly[away]19:16
bkeroUnless you have one already: https://etherpad.openstack.org/p/xenial-newton-tasks19:17
clarkbI didn't thanks19:17
*** sarob has quit IRC19:17
jlkI +1'd your -119:17
*** fifieldt has joined #openstack-infra19:18
*** asettle has joined #openstack-infra19:18
nibalizerjlk: i never got credentials19:19
anteayajlk: thank you19:19
*** ljjjustin has quit IRC19:20
*** mdrabe has quit IRC19:22
*** jcoufal has quit IRC19:23
*** asettle has quit IRC19:23
openstackgerritMatthew Treinish proposed openstack-infra/puppet-subunit2sql: Make sure global worker defs only done once  https://review.openstack.org/34753019:23
*** ljjjustin has joined #openstack-infra19:24
*** mdrabe has joined #openstack-infra19:25
openstackgerritMatthew Treinish proposed openstack-infra/system-config: Revert "Only start 1 subunit worker per node"  https://review.openstack.org/30915819:26
*** inc0 has quit IRC19:27
mtreinishjesusaur, corvus, clarkb: ^^^ that should fix the issue there19:27
*** rbuzatu has joined #openstack-infra19:30
*** gyee has quit IRC19:34
*** chem is now known as chem|off19:35
*** rdx_matt has joined #openstack-infra19:35
*** sdake has joined #openstack-infra19:36
*** rdx_matt has quit IRC19:36
*** rbuzatu has quit IRC19:36
*** rdx_matt has joined #openstack-infra19:36
anteayapleia2: I read the responses to about half your questions on the interview, nicely done19:40
*** kaisers_ has quit IRC19:40
pleia2anteaya: thank you19:40
anteayapleia2: I skipped the gender bits19:40
anteayawomen always get asked the gender question, I never see it in interviews with men19:40
anteayashame it took up half of your page space19:40
anteayanice write up on the upcoming talk19:40
anteayawell done19:40
*** rbuzatu has joined #openstack-infra19:41
pleia2thanks, I'm excited (I fly out on Friday)19:42
*** weshay has joined #openstack-infra19:42
anteayawoooo, safe flight to you19:42
anteayadirect?19:42
*** ddieterly[away] is now known as ddieterly19:42
*** ganso has joined #openstack-infra19:42
anteayaor do you have many flights?19:42
bkeroHave fun at SANOG!19:43
gansoclarkb: ping19:44
clarkbganso: pong19:44
gansoclarkb: Hi, are you Clark Boylan?19:44
clarkbthat is me19:45
osnexusIt's like peeling spiderman's mask off19:45
pleia2anteaya: connecting through abu dhabi on my way out, london on my way back19:45
gansoclarkb: My CI has been failing since merge of https://review.openstack.org/#/c/299677/19:45
gansoclarkb: log is here http://openstack.fit-tecnologia.org.br:10000/34/329134/11/check/hitachi-hsp/7ff13ff19:46
pleia2bkero: thanks :)19:46
gansoclarkb: could you please shed some light on what could possibly be the issue?19:46
gansoclarkb: not sure if my CI requires an update19:46
gansoclarkb: to be compatible with your patch19:46
*** rbuzatu has quit IRC19:46
anteayapleia2: never been to abu dhabi airport19:46
pleia2me neither :)19:47
anteayapleia2: do share your impressions, london I have seen19:47
clarkbganso: it shouldn't, but maybe you have broken clocks in your env?19:47
gansoclarkb: most likely, my CI setup restores snapshots for every run19:48
clarkbganso: according to http://openstack.fit-tecnologia.org.br:10000/34/329134/11/check/hitachi-hsp/7ff13ff/logs/devstack-early.txt it takes a few hours to build wheels19:49
*** arif-ali has quit IRC19:49
gansoclarkb: but it seems it calculates time with the wrong clock, then update during job, and then it exceeds the timeout19:49
clarkbganso: is it possible you are blocking ntp traffic?19:50
clarkbganso: and then devstack opens up the firewall letting it update?19:50
clarkbganso: its really hard to read in your logs because much of it lacks timestamps19:50
gansoclarkb: it is not blocking, it is probably not up-to-date right when devstack starts19:50
clarkbganso: you can see it update right at the beginning of the job http://openstack.fit-tecnologia.org.br:10000/34/329134/11/check/hitachi-hsp/7ff13ff/console.html19:52
clarkbganso: "waiting for ntpd to synchronize"19:52
*** rbuzatu has joined #openstack-infra19:52
clarkbganso: but without timestamps there its hard to say19:52
gansoclarkb: humm19:53
gansoclarkb: I can see the timestamp in jenkins19:53
gansoclarkb: 14:25:33 Waiting for ntpd to synchronize...  OK!19:53
gansoclarkb: 15:06:19 + echo 'Job timeout set to: -91 minutes'19:53
clarkband yet the log further down is 11:5819:54
gansoclarkb: this is very weird19:54
clarkbganso: you should boot an isntance in your cloud, check if the date/timestamp is correct on boot, then run the ntpd-wait and see what happens19:54
clarkbganso: is it possible the underlying hypervisor is changings its clock or something?19:55
gansoclarkb: I am not sure, it wasn't doing so before19:55
*** rbuzatu has quit IRC19:57
clarkbganso: also maybe it is possible ntp-wait is fighting something else in your system? or you are using utc and not utc in some places and it gets confused?19:57
gansoclarkb: possibly, because my timezone is utc -319:57
gansoclarkb: it has decreased the time from 14 to 11 in the logs19:57
dhellmannfungi : when the infra meeting is done, if you have a few minutes to look into some weirdness with the tag-releases job I'd appreciate it. Details in https://etherpad.openstack.org/p/release-automation-debugging19:57
gansoclarkb: but it is decreasing twice19:58
clarkbganso: our recommendation is to always use utc19:58
*** asettle has joined #openstack-infra19:58
*** asettle has quit IRC19:58
gansoclarkb: I'll take a look into how to force utc19:58
fungidhellmann: can do19:58
dhellmannfungi : ty19:58
clarkbganso: I do not know why ntp-wait would act differently than ntpdate. SUpposedly ntp-wait is the future and ntpdate is deprecated19:59
gansoclarkb: thanks19:59
gansoclarkb: humm I never used ntp-wait before19:59
*** rossella_s has quit IRC19:59
pleia2zaro: hehe20:00
*** rossella_s has joined #openstack-infra20:00
prometheanfirebkero: it does, but our puppet runs many other (unneeded) things as well20:00
prometheanfirethink we should talk here now :P20:00
mtreinishfungi: I'm gonna bug you about https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+branch:master+topic:firehose right after the meeting20:00
clarkbbkero: ok I put some stuff in the etherpad with a link to a change that should be a decent example20:00
mtreinishhopefully while you get a free sec to hit +A :)20:01
fungimtreinish: thanks! i will get to it20:01
clarkbbkero: maybe look that change over and let me know if you have questions about it?20:01
*** coolsvap_ has quit IRC20:01
clarkbis it #status log to log things?20:01
mtreinishfungi: thanks20:01
*** jiggangalator has quit IRC20:02
clarkb#status help20:02
openstackstatusclarkb: unknown command20:02
clarkbheh20:02
*** amitgandhinz has quit IRC20:02
bkeroclarkb: Been looking at it, seems to make sense.20:03
*** amitgandhinz has joined #openstack-infra20:03
clarkb#status log restarted logstash worker and logstash indexer daemons to get logstash data flowing again.20:03
openstackstatusclarkb: finished logging20:03
*** rbuzatu has joined #openstack-infra20:03
clarkbthe entire pipeline seemed to have fallen over around 1300UTC. daemons all running but not processing data20:04
prometheanfireso, do I need to wait til things are converted to ansible before I move forward on building an image that osa can use20:04
*** timello has quit IRC20:04
bkeroclarkb: so just doing check tests for now, gate to come later?20:05
*** sarob has joined #openstack-infra20:05
clarkbbkero: no we have been doing both, coverage is largely not in the gate though there are a couple projects that gate on it and should be updated20:05
clarkbI think ironicclient or maybe ironic?20:05
bkeroAh that explains the lack of gate job mods in that review20:06
*** Apoorva has quit IRC20:06
clarkbbkero: I have been going by job so far rather than by project or pipeline because we don't want to run the job one way in check and another in gate for example20:06
bkeroright20:06
clarkbor if its an integration test we don't want to run different jobs against two projects that need to be testing the same20:06
*** zzelle_ has joined #openstack-infra20:06
bkeroDoing it by job (or job-group) makes sense20:08
*** rbuzatu has quit IRC20:08
*** mtanin___ has joined #openstack-infra20:08
clarkbganso: I wonder if its possible that ntp-wait is somehow updating the underlying clock then later the hypervisor sets it back to utc-320:08
gansoclarkb: I am rebuilding last job with sudo timedatectl set-timezone UTC and sudo service ntp restart before stacking20:08
*** mtanino has quit IRC20:09
prometheanfireso who do I have to bug to try out a reduced ansible/puppet run for the image building?20:09
*** akshai has quit IRC20:09
*** EricGonczer_ has joined #openstack-infra20:10
*** rdx_matt has quit IRC20:10
clarkbprometheanfire: you are just looking for people to build the images to see if that works?20:10
* clarkb has a VM to build images with dib locally and can run a thing if given a set of elements20:10
prometheanfireI've already tried the full puppet run, just about every module needs added gentoo support (with various levels of suck)20:11
*** jiggalator is now known as netzin20:11
*** mtanino has joined #openstack-infra20:11
prometheanfireclarkb: I've done the same, but the elements that we use run too much for my use case20:11
clarkbnot sure why you mean by run too much for your use case20:11
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Remove EPEL usage  https://review.openstack.org/34749920:12
prometheanfirepuppet just needs to create a user, let's see if I can find the command20:12
*** mtanin___ has quit IRC20:12
clarkbprometheanfire: then maybe you should use your own elements? I think I am missing some important piece of context. What is the goal here?20:12
prometheanfireDIB_INSTALLTYPE_pip_and_virtualenv=package DIB_INSTALLTYPE_simple_init=repo disk-image-create -x --no-tmpfs -o $IMAGE_NAME $DISTRO vm openstack-repos nodepool-base simple-init growroot20:12
*** zzelle_ has quit IRC20:12
prometheanfireI'm trying to build a nodepool image to add gentoo support to openstack-ansible20:13
clarkbprometheanfire: ok, we aren't going to drop the stuff in our iamge builds to do that20:13
clarkbprometheanfire: if the goal is to have openstack-ansible use these iamges upstream we will need to sort out how to get those bits into gentoo images20:13
clarkbrather than just cutting it down to create a user20:13
prometheanfireso, either I add gentoo support to all the puppet modules, only to have to do the same in ansible, or wait for ansible20:14
prometheanfireDIB_INSTALLTYPE_pip_and_virtualenv=package DIB_INSTALLTYPE_simple_init=repo disk-image-create -x --no-tmpfs -o $IMAGE_NAME $DISTRO vm openstack-repos puppet nodepool-base cache-bindep simple-init growroot20:14
*** rbuzatu has joined #openstack-infra20:14
prometheanfireI think that was it, adding puppet / cache-bindep20:15
*** amitgandhinz has quit IRC20:15
*** amitgandhinz has joined #openstack-infra20:15
clarkbprometheanfire: my guess is that most things should work except where we puppet? is that correct?20:16
prometheanfireeverything except puppet works20:16
clarkbcache-bindep likely needs to learn how to properly cache things maybe?20:17
prometheanfireno, that works20:17
clarkbprometheanfire: ok so the next step would be correcting puppet?20:17
prometheanfireI added support months ago20:17
prometheanfireya, and it's overwhelming20:17
prometheanfirehttps://review.openstack.org/#/c/30755320:17
*** Apoorva has joined #openstack-infra20:17
prometheanfirehttps://review.openstack.org/#/c/31086520:17
prometheanfirehttps://review.openstack.org/#/c/31586520:17
*** timello has joined #openstack-infra20:18
clarkbnone of those changes involve puppet?20:18
prometheanfirethey don't20:18
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Remove EPEL usage  https://review.openstack.org/34749920:18
*** bhavik has quit IRC20:18
prometheanfiresome of the puppet modules are outside of openstack's control anyway20:18
clarkbI don't doubt its a pain to add support to puppet to run on gentoo, our stuff has long assumed fedora/centos/ubuntu20:18
clarkbprometheanfire: we shouldn't be using much of them in the test image builds though, tahts fairly constrained I think20:19
*** rbuzatu has quit IRC20:19
corvusright, most of our puppet modules are for long running servers.  only a handful should be used in the image builds20:19
clarkbI think its mostly make sure tox, users, iptables, and I am sure a small number of things I am forgetting are installed20:21
corvuscreate user, set up exim, unbound, iptables, ntp are the big things that come to mind.20:21
prometheanfireI was told it'd need to be a slave20:21
corvusand realistically, those are the things that would be needed to be ported to dib elements to complete the de-puppetification of the images20:22
corvusthere are some sysloc tweaks20:22
*** markusry has quit IRC20:22
corvussyslog20:22
prometheanfirethat's fine too, we have many syslogs to choose from :P20:22
clarkbso anyways I think these are thigns we woulnd't avoid, we need to solve it somehow20:23
prometheanfireI do know ansible, if we have open bugs against a repo I can submit reviews against I can help there20:23
prometheanfiremulti-os in ansible is fairly straight forward as well, at least it has been in OSA20:23
clarkbprometheanfire: we aren't using ansible for anything like that right now20:23
prometheanfireoh20:24
clarkbso there really isn't a repo you can just push a change to20:24
corvusi think the best ways forward are to make the subset of puppet used to build the images support gentoo, or (preferred), work on moving that subset to dib elements.20:24
prometheanfireworking on defining that subset is the first step20:25
clarkbprometheanfire: its defined at https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/single_use_slave.pp20:25
prometheanfireproject-config/nodepool/elements20:25
prometheanfireya20:25
*** kgiusti has left #openstack-infra20:25
prometheanfirethere too20:25
corvuswe did just manage to move the zuul user creation into an element20:25
*** rbuzatu has joined #openstack-infra20:25
corvusso if we finish moving to using that user instead of jenkins, we can drop the part of puppet that makes the jenkins user20:26
clarkband now that we are fully bindep we can drop the thin vs thick distinction and completely remove the thick slave puppetry20:26
clarkbwhich leaves you with slave common and the bits from template20:26
*** asettle has joined #openstack-infra20:26
prometheanfireiirc the count of puppet modules used was large, well over 2020:28
prometheanfirebecause of deps between them20:28
prometheanfireso it's not as simple as made out20:28
clarkbprometheanfire: to puppet all our things yes, but it shouldn't be for just the test images20:28
*** Nikolay_St has quit IRC20:28
clarkbprometheanfire: iptables, unbound, exim are probably going to be the big ones20:28
prometheanfirethat shouldn't be so bad really20:28
clarkbwe just said you can drop all the stuff from the thick slave and if you finish the move away from the jenkins use the jenkins moduel too20:29
*** abregman has quit IRC20:29
prometheanfirehuh?20:29
clarkbprometheanfire: corvus metnioned we don't need to make the jenkins user anymore if we switch to the new zuul user. That removes one dep (puppet-jenkins)20:29
prometheanfireright20:30
clarkbin the past we had two slave types. thick and thin. thick provisioned had a bunch of preinstalled and configured stuff like mysql postgres mongodb zookeeper and so on. You don't have to worry about that anymore20:30
prometheanfirewhere's the bug/review for that?20:30
*** rbuzatu has quit IRC20:30
*** mtanin___ has joined #openstack-infra20:30
prometheanfireya, that's what I was running into last time, was told I'd have to support that by fungi iirc20:30
clarkbthis reduces the lsit of deps to pretty much things things necessary to have a functioning server like ntp, iptables, users, dns resolution20:31
fungisupport what?20:31
*** dkehn has joined #openstack-infra20:31
prometheanfirethick20:31
corvusprometheanfire: https://review.openstack.org/32354020:31
*** mtanino has quit IRC20:32
clarkbcorvus: does nodepool also need to be told to use zuul?20:32
fungiprometheanfire: no, our entrypoint is openstack_project::single_use_slave with thin=false since we moved to installing dependencies and doing database setup at job runtime months ago20:33
corvusclarkb: oh yeah, probably so20:33
fungier,with thin=true20:33
fungi(so without the thick_slave class)20:33
clarkbso yes there is work to be done but it shouldn't be insurmountable and it is important configuration20:34
prometheanfirefungi: dunno how many months, but a couple of months ago it was trying with thick iirc20:34
fungiprometheanfire: it's likely you started working on gentoo support while that wasn't complete yet20:34
prometheanfireya20:34
prometheanfireglad I waited lol20:34
*** osnexus has quit IRC20:34
*** jsavak has quit IRC20:34
*** Teresita-Warrior has quit IRC20:34
prometheanfirejust getting back to this after life distractions20:34
*** osnexus has joined #openstack-infra20:35
*** Teresita-Warrior has joined #openstack-infra20:35
*** jsavak has joined #openstack-infra20:35
fungiprometheanfire: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/prepare-node/install.d/20-prepare-node#n2520:36
*** Teresita-Warrior has quit IRC20:36
clarkbbkero: you don't happen to be in portland this week do you? we could possibly find a corner somewhere and hack on this stuff later this week. Maybe friday (though if work goes well ebtween now and then likely not necessary)20:36
*** rbuzatu has joined #openstack-infra20:37
clarkbbkero: thursday afternoon is looking bad for me but tomorrow is another possibility20:37
sdakeAJaeger did you know the #17 is the number most likely to be picked at random by a human being?20:37
bkeroclarkb: am in portlanf all this week20:37
bkerocan do tomorrow20:37
clarkbcool20:38
bkerosomeplace out on west side?20:38
prometheanfireif I update https://review.openstack.org/#/c/307553 and https://review.openstack.org/#/c/310865 will it actually get reviewed or just ignored again?20:39
prometheanfirethose are needed in order for the puppet work to begin I think20:40
*** jtomasek has joined #openstack-infra20:40
*** rbuzatu has quit IRC20:41
clarkbprometheanfire: neither should be required, those are both job runtime deps not image build pupept deps20:41
*** jtomasek has quit IRC20:41
*** jtomasek has joined #openstack-infra20:41
clarkbI personally would probably like to see more progress on the image build side before we bother with job runtime reqs20:42
prometheanfireoh, ok20:42
clarkbbefore you run jobs on the images you will wnt those20:42
*** gyee has joined #openstack-infra20:43
*** piet_ has quit IRC20:43
*** Na3iL has quit IRC20:43
prometheanfirewell, running dib now (previously mentioned command/option)20:43
prometheanfireis everything running stackviz now?20:44
clarkbprometheanfire: its on all the images but only devstack-gate jobs are using it I think20:44
prometheanfireI'll ignore that then as osa doesn't use it20:46
*** Guest7651 has quit IRC20:46
*** netsin has quit IRC20:46
*** netzin has quit IRC20:46
*** pt_15 has quit IRC20:46
prometheanfire - name: ubuntu-precise does not use it either20:46
*** e0ne has quit IRC20:46
prometheanfirepackage-installs needs to be updated20:47
clarkbah ya since precise is only used for one or two infra jobs while we finish our migration off of precise20:47
prometheanfirefor infra-package-needs20:47
fungiyeah, ubuntu-precise is going away rsn. it's used for a couple of puppet modules we still deploy on precise while we're working through a few lingering server upgradews20:47
prometheanfireso I do need to submit package-map updates at least20:47
*** rbuzatu has joined #openstack-infra20:48
clarkbprometheanfire: gentoo has different name for the openssh server package?20:48
*** shashank_hegde has joined #openstack-infra20:48
clarkb(not surprising, its unfortunate every distro has its own set)20:48
prometheanfireno, but we don't call 'cron' cron20:48
clarkbah20:48
prometheanfirenet-misc/openssh20:48
openstackgerritIsaku Yamahata proposed openstack-infra/project-config: networking-odl: add irc notification  https://review.openstack.org/34752220:48
fungiprometheanfire: thinking back to earlier conversations about gentoo support, what i actually recall telling you you're going to need to support is bindep (it's how we got off running jobs on thick slaves), and you've done that so i think i steered you right20:48
prometheanfirebuild essencials aren't needed, etc20:49
clarkbprometheanfire: build essentials is implied on gentoo I guess :)20:49
fungihah20:49
prometheanfirefungi: ya, the bindep stuff was easier :P20:49
fungican't gentoo if you can't build ;)20:49
openstackgerritMerged openstack/diskimage-builder: Correct order of parameters in call to tune2fs  https://review.openstack.org/34526120:49
prometheanfirecronie was fine for cron right?20:50
prometheanfireor did you want another20:50
*** itisha has quit IRC20:50
rajinirNT synchronization is taking very long like 10 mins.  Waiting for ntpd to synchronize...  Any ideas on what could be wrong20:50
clarkbwhatever is the default or suggested cron is probably fine20:50
prometheanfirelooks like I already submitted https://review.openstack.org/#/c/310865/3/nodepool/elements/infra-package-needs/pkg-map lol20:50
clarkbrajinir: are you blocking ntp packets with a firewall maybe?20:51
clarkbrajinir: it should happen within the amount of time necessary to send a few packets back and forth20:51
prometheanfireDIB_INSTALLTYPE_pip_and_virtualenv=package DIB_INSTALLTYPE_simple_init=repo disk-image-create -x --no-tmpfs -o $IMAGE_NAME $DISTRO vm openstack-repos puppet nodepool-base cache-bindep infra-package-needs simple-init growroot20:53
*** rbuzatu has quit IRC20:53
prometheanfireok, with https://review.openstack.org/#/c/310865 it should work I think, those were the only elements that needed changing20:53
clarkbianw: greghaynes ^ is why I think dib should make useable images by default fwiw20:53
clarkbianw: greghaynes the fact that we are boostrapping it ourselves means that anytime someone different wants useable VMs we have to reinvent all that work again20:53
clarkbre infra-package-needs and adding more distros to it20:53
rajinirclarkb: nope. firewall is disabled20:55
clarkbrajinir: I am not sure then, try running it manually on a new instance booted off the image and see what it tells you?20:56
rajinirclarkb: ok, thank you20:56
*** adrian_otto1 has joined #openstack-infra20:56
*** sarob has quit IRC20:57
openstackgerritSpencer Krum proposed openstack-infra/jeepyb: Make protocol configurable  https://review.openstack.org/34613920:57
*** arif-ali has joined #openstack-infra20:57
*** Teresita-Warrior has joined #openstack-infra20:57
openstackgerritTony Breeds proposed openstack-infra/project-config: Switch all xstatic projects to the correct publish job  https://review.openstack.org/34755020:57
*** adrian_otto has quit IRC20:58
prometheanfirewell, testing20:58
prometheanfire(0043 / 1068)20:58
prometheanfireugh20:58
prometheanfireforgot about that lol20:58
*** rbuzatu has joined #openstack-infra20:59
*** netsin has joined #openstack-infra21:00
*** sarob has joined #openstack-infra21:01
corvusflaper87: is there background reading material on https://review.openstack.org/342069  ?21:01
*** sarob has quit IRC21:01
*** _sarob has joined #openstack-infra21:01
*** julim has quit IRC21:02
*** trown is now known as trown|outtypewww21:02
*** raildo has quit IRC21:03
fungiflaper87: yeah, identifying how it differs from the meeting implementation would be helpful (skimming, it seems it's mostly just renaming "meeting" to "table" for no concrete benefit)21:03
fungiwell, s/renaming/copying/21:03
*** rbuzatu has quit IRC21:04
fungioh, i see. it's for explicitly voicing/devoicing in meetings21:04
corvusfungi: though it does not actually voice/devoice afaict21:04
corvusanyway, was wondering what the motivation was; is somewhat difficult to tell whether it may achieve its goal21:06
fungiahh, so honor system voice/devoice21:06
openstackgerritMichael Krotscheck proposed openstack-infra/project-config: Added documentation draft jobs for nodejs-based projects  https://review.openstack.org/34613021:06
openstackgerritMichael Krotscheck proposed openstack-infra/project-config: Added documentation publish jobs for the JavaScript SDK  https://review.openstack.org/34613121:06
openstackgerritMichael Krotscheck proposed openstack-infra/project-config: Created jobs for nodejs version 6  https://review.openstack.org/34450121:06
funginot irc-level implementation of it21:06
*** rdx_matt has joined #openstack-infra21:06
*** psilvad has quit IRC21:06
*** rlandy has quit IRC21:06
*** rdx_matt has quit IRC21:06
fungiyeah, i'm curious who has requested this and for what meetings21:06
*** xyang1 has quit IRC21:06
fungiit seems like a lot of additional formality over how the community generally runs meetings21:07
openstackgerritMerged openstack/diskimage-builder: Correct order of parameters in call to qemu-img convert  https://review.openstack.org/34526221:07
*** rdx_matt has joined #openstack-infra21:07
*** rlandy has joined #openstack-infra21:07
*** rockyg has quit IRC21:08
*** nwkarsten has quit IRC21:09
clarkbI also worry that devoicing 800 nicks will take forever21:09
anteayaare there not enough semi quiet channels in which to have an uniterrupted chat?21:09
anteayaclarkb: he he21:10
anteayaI totally get the merits of having an uninterrupted conversation21:10
*** rbuzatu has joined #openstack-infra21:10
anteayaI think we can socialize our way to that goal if it is a shared goal21:10
openstackgerritMerged openstack-infra/irc-meetings: Change the date and chair of the HA guide team meetings  https://review.openstack.org/34658421:11
*** armax has joined #openstack-infra21:11
*** rfolco has quit IRC21:12
*** adrian_otto1 has quit IRC21:13
openstackgerritMerged openstack-infra/irc-meetings: Add Meeting Information for New Project daisycloud-core  https://review.openstack.org/34653421:14
*** rbuzatu has quit IRC21:14
*** ldnunes has quit IRC21:15
rajinirclarb: solved the ntp issue. The host machine on Devstack-CI was not synchronized. Thanks21:16
*** thorst has quit IRC21:16
*** adrian_otto has joined #openstack-infra21:17
*** rbuzatu has joined #openstack-infra21:21
fillerohai infra!  can users disable mail notifications from gerrit?21:25
fillerfwict, no.  would like to get bot/ci accounts out of the receiving mail game if possible.21:25
*** rbuzatu has quit IRC21:25
fungifiller: not to my knowledge. you can unsubscribe from everything except changes on which you're an owner and changes on which you post review comments21:25
*** StevenK has quit IRC21:25
*** vkramskikh has quit IRC21:25
*** rm_work has quit IRC21:25
*** mjb has quit IRC21:25
*** jsavak has quit IRC21:26
fillerdang.  yeah, we want ci to comment on pass/fail but not receive any notifications.21:26
*** jkilpatr has quit IRC21:26
*** aysyd has quit IRC21:26
fillerbarring a passwd reset.  :P21:26
fungifiller: sounds like a good feature request for gerrit upstream. zaro: do you happen to know if something like that is already in the works in newer gerrit releases?21:26
*** rm_work has joined #openstack-infra21:26
mugsiefiller: I ended up writing a filter for gerrit, where it was sent to the bot email21:26
*** jsavak has joined #openstack-infra21:27
fungiyeah, i actually have some fairly complex parsing filters for e-mail i receive from gerrit, so i can strip it down to just notifications i care about21:27
fungiand the rest goes into the bucket21:27
*** nwkarsten has joined #openstack-infra21:27
mugsie++21:27
*** mjb has joined #openstack-infra21:28
fungiand i'm not operating a bot. i simply end up subscribed to thousands of open changes21:28
fungifor a variety of reasons21:28
*** kaisers_ has joined #openstack-infra21:28
fillerbecause reasons. :)21:29
fillerthx fungi.21:29
prometheanfireMissing package name for distro/element: gentoo/zuul-worker21:29
prometheanfirehuh21:29
zarofiller: all email or just ones directed towards you?21:30
zarobecause i think there's a global setting to stop all and there's user setting to disable21:31
*** vkramskikh has joined #openstack-infra21:31
*** nwkarsten has quit IRC21:31
fungizaro: ability for an account to tell gerrit not to send it any e-mail about updates to any changes21:31
*** matt-borland has quit IRC21:32
*** nwkarsten has joined #openstack-infra21:32
*** rbuzatu has joined #openstack-infra21:32
zaroi a see a email:disable option in user preferences but looks like that's only for newer gerrit21:33
fillerzaro: in this case, an externally deliverable dlist for an openstack product team.  dont bitbucket all mail because i might want to roll a passwd.  but if i want to get zero mail comms about patchsets which the bot might test, provide pass/fail feedback on, vote, whatever.21:33
fungizaro: what release did that first appear in?21:33
*** kaisers_ has quit IRC21:33
filleryeah, gerrit gerrit allows it.  didnt know if we were missing something obvs for openstack gerrit :)21:33
*** _sarob has quit IRC21:33
zaroyeah, i'm looking at gerrit's gerrit21:34
zarowhich is 2.12.321:34
mugsiefiller: http://status.openstack.org/openstack-health/#/g/project/openstack~2Fdesignate might be a good place to look at red/green status21:34
openstackgerritMerged openstack-infra/project-config: Add puppet-germqtt project  https://review.openstack.org/34449321:34
mtreinishfungi: ^^^ thanks21:36
*** ramishra has quit IRC21:36
* mtreinish must make a mental note to stop pushing to github now21:36
*** ramishra has joined #openstack-infra21:36
*** jsavak has quit IRC21:36
*** rbuzatu has quit IRC21:37
fungimtreinish: yeah, i'm flushing those through while multi-tasking a bunch of other stuff21:37
mtreinishsdague: do you have any experience writing acl files for mosquitto? Or did you just leave it all open behind the firewall on your home setup?21:37
fungipabelanger: are you back yet? need me to carry over your skipped meeting topic to next week?21:38
mtreinishfungi: heh, well now comes the fun part of trying to get all the random stuff I wrote to work :)21:38
corvusmtreinish, fungi: i'm about to tag/release gertty from current master -- can you think of anything i might have missed?21:40
corvusoh, like maybe https://review.openstack.org/31356321:41
*** rdx_matt has quit IRC21:41
*** rhallisey has quit IRC21:41
fungishould that improve sync performance?21:41
corvusi think it will just not fail to sync some chanegs21:41
mtreinishcorvus: the only things I have checked out locally are the email patch and your db variables fix. Both of which you merged already21:42
fungiaha, yes i see now21:42
mtreinishI probably should repull master now21:42
clarkbI have been using master recently and works fine locally21:42
fungii tend to just always use master unless i'm trying out additional proposed features/fixes21:42
corvusmtreinish, fungi, clarkb: cool -- i merged a handful of changes a few hours ago, so if you have a sec to update and sanity check, that'd be swell21:43
corvusi will probably merge 313563 before release too, if you want to cherry-pick it21:43
*** rbuzatu has joined #openstack-infra21:43
fungidoing that now21:43
mtreinishcorvus: current master looks good, from a 30sec test :)21:44
corvusi *think* you wouldn't run into the problem fixed by 313563 unless you owned or had starred > 500 changes21:44
mtreinishI'll cherry-pick that commit now21:44
corvusso pretty much mordred or fungi :)21:44
*** megm has quit IRC21:44
fungii haven't really been using starring21:44
mtreinishwell that rules me out, I think I sit in about only 150-200 active things21:45
*** ccamacho|away has left #openstack-infra21:45
mtreinishoh, starred. I don't use that too much21:45
fungii keep meaning to find a way to work it into my routine21:45
*** ayoung has quit IRC21:45
corvusor owned21:45
corvuswas thinking the classic 'update all the projects' changes :)21:45
fungiahh, maybe then21:46
fungiit's been a while since i've done one of those so my owned changes count may be under 500 now21:46
mtreinishcorvus: only have ~45 owned changes right now21:46
mtreinish*open21:46
mtreinishso I'm probably pretty far off from that issue21:47
fungiwow, i have under 100 owned changes open at this point. i'm seriously slacking21:47
*** megm has joined #openstack-infra21:47
*** rbuzatu has quit IRC21:47
clarkbit turns out I need to cleanup jenkins/jobs/devstack-gate.yaml before worrying about xenialiing it21:49
clarkbthe exciting thing is we actually have at least one job in there we can remove :)21:49
bkerolightening++21:49
mtreinishfungi: heh, no mass update this link across all repo changes lately?21:50
fungidarkening21:50
*** ddieterly is now known as ddieterly[away]21:50
fungimtreinish: nope. so much ptl21:50
* fungi gets back to important mascot-related tasks21:51
* clarkb wonders why we have a dsvm-smoke-tlsproxy job instaed of just turning on tlsproxy by default in all jobs21:51
clarkbI doubt anyone actually watns to run openstack without ssl21:51
mtreinishfungi: is a steel girder on the list of choices?21:51
fungimtreinish: it is now!21:51
fungimtreinish: though i think that doesn't count as a natural feature21:52
corvushow about "igneous rock" ?21:52
funginice. that counts!21:52
corvussort of the natural equivalent21:52
mtreinishhah, not metamorphic?21:52
* fungi feels like we're more sedimentary most days21:53
mtreinishclarkb: probably because it's been hard to get running reliably21:53
clarkbmtreinish: ya beacuse we don't test it :P21:53
corvusfungi: actually, i think sedementary rock may tend to have more iron in it... :)21:53
clarkbmtreinish: I bet if we turned it on and got it merged as a default it would get reliable really quickly21:53
corvusfungi: er, that was better the way you spelled it21:53
fungiclarkb: there was a dev ml thread just yesterday/today talking about it. i think the change is already proposed21:53
mtreinishclarkb: more likely it would get reverted when the fail rate approached 5%. But I get what you're saying21:54
mtreinishfwiw, the puppet integration jobs all run with everything ssl'd and ipv6ified21:54
fungithough i'm with mtreinish, metamorphic rock is more like steel... folded and hardened under extreme temperatures and pressures21:54
*** ddieterly[away] has quit IRC21:54
*** rbuzatu has joined #openstack-infra21:54
corvusgo with that then21:54
*** esberglu has quit IRC21:55
clarkbfungi: ya I responded to it with my "look it dun work" change I pushed a few months ago21:55
fungiclarkb: ahh, that was you. i bet i was skimming too fast to notice who the reply was from21:55
*** asettle has quit IRC21:56
clarkbjroll: JayF: I am trying to clean out jenkins/jobs/devstack-gate.yaml to simplify the addition of xenial jobs and notice that ironic may still have some crufty unused jobs. ironic-agent_ssh-src and ironic-pxe_ipa-src are currently unused, is that intentional and can I delete them?21:57
*** gildub has joined #openstack-infra21:57
clarkbmtreinish: fungi we have a problem where we are so afraid of things like that that instead of just making them default for sanity reasons when they do work we make new jobs and stick them in the experimental corner and forget about them then the feature never works21:57
jrollclarkb: yes, the ones in use are all tagged with an image type21:57
jrollclarkb: someone was working on cleaning a bunch of things up, not sure where it ended up21:58
clarkbjroll: not sure I understand what that means but zuul does not know about these two jobs so they are not in use. Does that mean I can delete them?21:58
jrollclarkb: yes, you can21:58
clarkbmtreinish: fungi: which is unfortunate for things like use tls beacuse any sane person would probably say its important to have21:58
clarkbjroll: thank you21:58
corvuseven those who are insane might think that21:59
jrollclarkb: this is the refactor but not sure if it solves that specific problem https://review.openstack.org/#/c/340567/21:59
*** rbuzatu has quit IRC21:59
mtreinishclarkb: sure, I don't disagree. I tend to be more straightforward with changes like that when I make them and just do it. THe problem is often who is working on these things tend not to communicate cross project so well and end up breaking the world without getting buy in from enough people and/or not being responsive on fixes22:00
clarkbjroll: looks like that does clean it up but that change is massive22:00
clarkbjroll: now to decide if I should try to get that change in today or work with removing just those two on my side22:00
clarkbshould probably just review that change22:00
jrollclarkb: exactly, if I were you I'd just remove those two, but that's your call :)22:00
*** darrenc is now known as darrenc_afk22:01
clarkbjroll: I should probably just try to get that in sooner than later otherwise its going to end up in merge conflict hell with the other work going on to use xenial22:02
clarkbmtreinish: ya I can see it being an issue if people aren't around to help debug. But I really hope that "we should test with ssl" is not a contentious issue22:03
anteaya+1 igneous rock22:03
jrollclarkb: true that, if you do review it I'll make sure we push it through, so thank you for that :)22:03
clarkbmtreinish: btw you are about to get all your tempest tests xenialed this week I hope22:03
mtreinishclarkb: nice22:03
*** openstackgerrit has quit IRC22:03
*** openstackgerrit has joined #openstack-infra22:03
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Temporary fix for nodejs/libuv conflict  https://review.openstack.org/34756522:05
*** mdrabe has quit IRC22:05
*** rbuzatu has joined #openstack-infra22:05
openstackgerritMerged openstack/gertty: Support SyncQueriedChanges batching in Gerrit >=2.9  https://review.openstack.org/31356322:05
anteayaI could also see the case for metamorphic too22:05
ianwdoes anyone have an issue with adding diskimage-builder to our libs-from-git for nodepool?  https://review.openstack.org/#/c/345814/  fairly obscure but i'd like to run that test against dib changes too22:06
*** EricGonczer_ has quit IRC22:06
*** Apoorva_ has joined #openstack-infra22:07
*** gordc has quit IRC22:08
*** kzaitsev_mb has joined #openstack-infra22:09
*** sdake has quit IRC22:09
openstackgerritClark Boylan proposed openstack-infra/project-config: Remove unused devstack-gate job  https://review.openstack.org/34756722:09
*** osnexus has quit IRC22:09
clarkbianw: hrm I thought I reviewed that change, I guess it didn't post. I don't have an issue with it let me properly post the review22:10
*** rbuzatu has quit IRC22:10
clarkboh I might have reviewed the job config side but not realized there was a nodepool change too22:10
*** osnexus has joined #openstack-infra22:10
*** sarob has joined #openstack-infra22:10
*** Apoorva has quit IRC22:11
ianwclarkb: cool, thanks -- i also put in https://review.openstack.org/#/c/345818/ to remove dib from PROJECTS -- it's really a client tool just like the python-* clients, so i don't think it belongs there22:11
clarkbbkero: https://review.openstack.org/347567 and https://review.openstack.org/#/c/340567/ are cleanups to make the set of devstack/tempest jobs less crazy22:11
bkeroclarkb: Awesome. Those job-templates-groups were a bit confusing to parse.22:12
bkeroAre those going to land sometime soon?22:12
*** cody-somerville has quit IRC22:12
clarkbbkero: I would like them to land today, I am going to review the ironic one in a couple minutes. Need more caffeine before digesting that one22:13
bkeroclarkb: you linked two of the same, I think you meant to link another one.22:13
clarkbbkero: the change I wrote should be straightforward hopefully we can get project-config cores to approve that one quickly22:13
clarkbthe numbers are very similar, fixed22:13
bkeroAh, yeah22:14
clarkbianw: reducing the PROJECTS list to a more devstack default need is a low priority item I keep trying to poke at. +222:14
anteayaarmax: dougwig are either of you available to +1 https://review.openstack.org/#/c/347567/1 please?22:15
armaxanteaya: on it22:16
anteayaarmax: thank you22:16
bkeroclarkb: I was going to tackle some of the simpler ones first. Was coming up on a proposed chef review for you.22:16
*** rbuzatu has joined #openstack-infra22:16
*** shashank_hegde has quit IRC22:17
anteayaarmax: thank you22:19
armaxanteaya: np22:19
*** rbuzatu has quit IRC22:21
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Temporary fix for nodejs/libuv conflict  https://review.openstack.org/34756522:22
*** moravec has quit IRC22:22
*** priteau has quit IRC22:23
*** jamielennox|away is now known as jamielennox22:23
*** edmondsw has quit IRC22:24
*** sarob has quit IRC22:25
*** thorst has joined #openstack-infra22:26
*** rbuzatu has joined #openstack-infra22:26
armaxanteaya: perhaps you can return the favor https://review.openstack.org/#/c/346701/22:26
armaxanteaya: :)22:26
*** erlon has quit IRC22:26
armaxanteaya: but I am happy to help unconditionally :)22:27
*** rbuzatu_ has joined #openstack-infra22:27
bkeroclarkb: something like http://paste.openstack.org/show/542182/ ?22:28
*** sarob has joined #openstack-infra22:30
fungihrm, looks like we're consistently running ~500 nodes in use and ~1000 jobs launched per hour, so i guess that means the average runtime across jobs (weighted by their frequency) is ~30 minutes22:30
fungithat's a handy number to keep in the back of my mind22:31
clarkbbkero: ya starting simple is good22:31
bkeroSome of the chef jobs were already xenial-ified, but that one didn't seem to be.22:31
bkero(and was the remaining one that wasn't)22:32
clarkbbkero: and taht diff looks about right. if you tox -e zuul it should tell you if you got all the bits to line up too22:32
clarkbI have been running that a lot locally22:32
*** rbuzatu has quit IRC22:32
*** Apoorva_ has quit IRC22:32
*** rbuzatu_ has quit IRC22:32
* bkero waits for the jjb run22:33
*** Apoorva has joined #openstack-infra22:33
*** signed8bit is now known as signed8bit_Zzz22:33
openstackgerritJames E. Blair proposed openstack-infra/project-config: Remove extraneous publish jobs from gertty  https://review.openstack.org/34757022:33
anteayaarmax: back now, my dad called to say his skin cancer is removed and no further problems with that spot, yay! his specialist keeps a good eye on him22:34
openstackgerritMatthew Thode proposed openstack-infra/project-config: Add Gentoo support to nodepool  https://review.openstack.org/31086522:34
*** gildub has quit IRC22:35
anteayaarmax: folks who worked in the sun all their lives need a good skin doctor in their 80s22:35
*** darrenc_afk is now known as darrenc22:35
armaxanteaya: glad to hear it, so many things they didn’t know back in those days22:36
anteayaarmax: I know it, was happy to have him call22:36
anteayahis doctor is aces22:36
*** rdx_matt has joined #openstack-infra22:37
*** rdx_matt has quit IRC22:37
*** sarob has quit IRC22:37
*** rdx_matt has joined #openstack-infra22:37
*** sarob has joined #openstack-infra22:38
*** tpsilva has quit IRC22:38
*** rbuzatu has joined #openstack-infra22:38
anteayaarmax: +322:39
anteayaclarkb: is this the patch you would like reviewed to further your dsvm/tempest work? https://review.openstack.org/#/c/340567/22:40
openstackgerritMerged openstack-infra/project-config: Run coverage jobs on xenial  https://review.openstack.org/34698722:42
openstackgerritMerged openstack-infra/project-config: Add puppet-mosquitto project  https://review.openstack.org/34438622:43
*** rbuzatu has quit IRC22:43
clarkbanteaya: that one and https://review.openstack.org/34756722:44
clarkbanteaya: will get claenup out of the way before we start editing all those jobs22:44
fungimtreinish: looks like 344495 is going to need a rebase. i'll push that now and reapprove22:44
anteayadone 347567, will look at 340567, thanks22:44
*** gouthamr has quit IRC22:45
mtreinishfungi: ok, cool thanks22:45
clarkbbkero: oh also I have been trying (and not always succeeding) to use the 'newton-xenial' topic in gerrit22:45
openstackgerritMatthew Thode proposed openstack-infra/project-config: add gentoo support to bindep-fallback.txt  https://review.openstack.org/30755322:45
bkeroclarkb: cool, I'll be sure to use that22:45
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Temporary fix for nodejs/libuv conflict  https://review.openstack.org/34756522:46
corvussebian, aspiers, prometheanfire, mtreinish: Gertty 1.4.0 released: http://lists.openstack.org/pipermail/openstack-infra/2016-July/004574.html22:47
*** sdake has joined #openstack-infra22:47
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Add germqtt project  https://review.openstack.org/34449522:48
anteayayay moar Gertty22:48
bkeroclarkb: how long does your tox -e zuul take?22:48
*** openstackgerrit has quit IRC22:48
anteayacongratulations corvus and group22:48
corvusSpamapS, mordred, fungi, clarkb: ^ gertty22:48
*** openstackgerrit has joined #openstack-infra22:48
anteayacorvus et al.22:48
corvusanteaya: it's a big group this time22:48
prometheanfirecorvus: nice22:48
anteayaI saw that22:48
anteayacorvus: you do attract the contributors :)22:48
*** sdake_ has joined #openstack-infra22:49
fungicorvus: thanks! i'll give my nova friend who was trying to use the last release a heads up (though i think he's just running master now anyway)22:49
aspierscorvus: how on earth did you remember I'm interested in gertty :)22:49
*** cody-somerville has joined #openstack-infra22:49
*** rbuzatu has joined #openstack-infra22:50
aspiersoh, maybe because of https://github.com/openstack/gertty/commit/c9651c1bb6ef7b36f2454011b680add22a88c15922:51
*** dimtruck is now known as zz_dimtruck22:51
corvusaspiers: git knows all :)22:52
prometheanfirecorvus: package updated and now using it :D22:52
aspiers:)22:52
aspiersI'd forgotten I contributed22:52
clarkbbkero: long time, it has to build all the jenkins jobs which is slow22:52
*** sdake has quit IRC22:52
*** baoli has quit IRC22:52
*** shashank_hegde has joined #openstack-infra22:52
bkeroclarkb: I was wondering if it was my laptop, so I'm trying on a desktop that should be reasonably fast now.22:52
clarkb5-8 minutes I would guess I haven't actually timed it22:52
*** kzaitsev_mb has quit IRC22:53
prometheanfirehttps://gitweb.gentoo.org/repo/gentoo.git/commit/?id=7ed3f4273043e2277e971939270356c907dc533d22:53
*** baoli has joined #openstack-infra22:53
prometheanfirecan you abandon changes you submit?22:54
mtreinishprometheanfire: oh, thanks for the reminder I should update the AUR package soon too22:54
*** Teresita-Warrior has quit IRC22:54
*** signed8bit_Zzz is now known as signed8bit22:54
prometheanfiremtreinish: :P22:54
prometheanfiremtreinish: it's a race you know22:54
mtreinishheh, then I always lose :)22:54
mtreinishI'm really slow on updating things there22:55
aspierscorvus: I'll update the SUSE packages22:55
corvusprometheanfire: can you expand the context of the question you just asked about abandoning changes?22:55
*** rbuzatu has quit IRC22:55
*** rbrndt has quit IRC22:55
clarkbaspiers: wait you mean I can just zypper install gertty?22:55
prometheanfiresure, I wasn't able to abandon changes in 1.3.222:55
prometheanfireor didn't see how22:55
fungiafter breaking down our mascot etherpad, we have 23 options to rank22:56
corvusprometheanfire: ah, yeah, i think that's been there a while -- it's ctrl-a by default22:56
fungii'm almost done generating the roll for civs now22:56
anteayafungi: wooo, sure to get conscensous on something, right22:56
aspiersclarkb: not quite, you'll need to do a one-click install via https://software.opensuse.org/package/python-gertty22:56
corvusprometheanfire: in 1.4.0 you can batch abandon a whole bunch at once :)22:56
anteayaclarkb: on the ironic re-write all the jobs patch, I am +222:56
aspiersclarkb: since the package is in devel:languages:python rather than a standard project22:56
prometheanfireoh, nice22:56
fungianteaya: we'll get the least contentious option across everyone who casts a vote, as condorcet intended!22:56
*** tqtran_ has quit IRC22:57
anteayaclarkb: personally I would like to see someone merge it who can revert it if something was overlooked22:57
anteayafungi: ha ha ha22:57
*** yamahata has quit IRC22:57
*** tqtran has joined #openstack-infra22:57
anteayaclarkb: it is a big change22:57
clarkbanteaya: thats fair I intend on reviewing it now ETOOMUCHGOINGON22:57
fungiprometheanfire: i had to generate a ton of test changes a while back across lots of different projects... used a consistent gerrit topic so when i was done i just queried that, process flagged the results and mass-abandoned22:57
anteayabut I am so glad the patch was created, the ironic jobs have been so hard to look at for some time now22:57
anteayaclarkb: I agree with you22:58
fungiprometheanfire: worked like a charm22:58
anteayaclarkb: just thought I would share my thoughts, not trying to pressure you22:58
prometheanfirefungi: awesome22:58
clarkbanteaya: oh no problem22:58
fungiprometheanfire: i was also using mass review to recheck them periodically22:58
anteayaclarkb: thanks22:58
anteayaclarkb: anything else I can review to help you?22:58
*** PollyZ has quit IRC22:58
aspiersoh, gertty distribution has changed to being a .whl22:58
fungiprometheanfire: and also for marking them all work-in-progress after uploading22:59
*** Teresita-Warrior has joined #openstack-infra22:59
corvusaspiers: looks like there's a tarball too22:59
aspierscorvus: where?22:59
aspierscorvus: you mean the source?23:00
corvusaspiers: i see both at https://pypi.python.org/pypi/gertty/1.4.023:00
aspiershttps://pypi.python.org/pypi/gertty/1.4.0#downloads23:00
*** Sukhdev has quit IRC23:00
aspiersyeah but that URL is non-deterministic23:00
aspiershttps://pypi.python.org/packages/9e/ed/dd19a67c287fede452473a685ae3e30dba48a5b280173872450c73a4f94d/gertty-1.4.0.tar.gz#md5=579416c212dd2bc089f3340d804da8d523:00
aspiershttps://pypi.python.org/packages/source/g/gertty/gertty-%{version}.tar.gz used to work23:00
corvusoh, yeah, i think they changed some stuff in pypi23:01
aspiers:-(23:01
*** rbuzatu has joined #openstack-infra23:01
corvusaspiers: dstufft would know more23:01
corvusothers may as well :)23:01
anteayaclarkb: oh and I don't think I saw that max servers change go past23:01
* anteaya looks23:01
aspierscorvus: I guess I could just get it from the git tag, right?23:01
corvusaspiers: i think the published tarball is better -- there are some things that are generated as part of building the release23:02
aspiersright, that's what I suspected23:02
anteayaclarkb: nope, I'll put it up now23:02
corvusaspiers: i think that url is stable23:02
aspierscorvus: stable but non-deterministic23:02
aspiersacross releases, I mean23:02
aspiersor you think the 9e/ed/dd... bit will stay across releases?23:03
corvusaspiers: right.  so with a new release, you can find the url, verify it, then add it to packaging systems.... (vague handwaving from person who is not a packager)23:03
dstufftaspiers: well it's completely deterministic, but it requires the contents of the package itself to determine it :)23:03
aspierswell, I guess the spec file has to be updated per release anyway23:03
*** Sukhdev has joined #openstack-infra23:03
*** kien-ha has joined #openstack-infra23:03
aspiersdstufft: haha, fair point :)23:03
openstackgerritMerged openstack-infra/project-config: Networking-l2gw: enable python 3 gating  https://review.openstack.org/34670123:03
dstufft(it's a blake2b hash of the contents of the file)23:03
aspierscorvus: yeah, it just breaks our system where we can update the version number, re-run the source service, and rebuild with no extra effort23:04
dstufftaspiers: also you can do files.pythonhosted.org/packages/source/g/gertty/gerrtty-%{version}.tar.gz23:04
*** ams__ has quit IRC23:04
dstufftit'll redirect you to the hashed url23:04
aspiersdstufft: ahhh, perfect!23:04
dstufftso as long as you follow redirects23:04
aspierssure23:04
aspiersdstufft: thanks :) is that URL discoverable somehow?23:04
aspiersother than by asking gurus, I mean23:04
aspiersjust curious23:04
dstufftaspiers: Not really no, we haven't documented it yet23:05
aspiersno problem :)23:05
corvusneat, this works:  wget https://files.pythonhosted.org/packages/source/g/gertty/gertty-1.4.0.tar.gz23:05
openstackgerritAnita Kuno proposed openstack-infra/project-config: Increase xenial max servers to 10  https://review.openstack.org/34757323:05
clarkbjroll: and you are happy with 340567? if I don't find any issue with it it is ok to approve now?23:05
openstackgerritMatthew Treinish proposed openstack-infra/puppet-germqtt: Ensure ssh keys are all setup  https://review.openstack.org/34757423:06
*** rbuzatu has quit IRC23:06
openstackgerritMatthew Treinish proposed openstack-infra/system-config: Add firehose.o.o config to system-config  https://review.openstack.org/34757523:06
mtreinishfungi: ^^^ I think I got that right, but who knows23:06
anteayaha ha ha, there's the voice of confidence23:06
*** Teresita-Warrior has quit IRC23:07
mtreinishwell I tested the puppet-mosquitto and puppet-germqtt modules locally (prior to that ssh file change, I did that manually since I had to use my creds) but not the system-config part23:08
mtreinishand in my experience it's death by 1000 patches whenever I do anything in puppet23:08
anteayamtreinish: ha ha ha23:08
anteayatrue that23:08
anteayaI thought 'and that is how you puppet'23:09
*** yamahata has joined #openstack-infra23:10
clarkblocal testing shows that in bash you can't define variables if you have extra whitespace before the varname eg ^     FOO=bar$ if you were matching with a regex23:10
clarkbdoes anyone know if that is actually the case or am I pebkacing?23:10
mtreinishthere is also the gaping security hole in puppet-mosquitto right now (or the complete lack of any)23:11
*** rdx_matt has quit IRC23:11
mtreinishso anyone can write to any topic on it. But that's a task for tomorrow or later in the week23:11
fungi798 contributors to infra repos over the past year23:11
anteayaclarkb: are you asking in context of the ironic job re-write patch?23:12
clarkbfungi: do you know the answer to my bash thing?23:12
clarkbanteaya: I am23:12
anteayafungi: yay us?23:12
fungiclarkb: checking scrollback23:12
clarkbanteaya: I believe the way they are quoting the heredoc will result in extra whitespace on the left23:12
*** rbuzatu has joined #openstack-infra23:12
clarkbanteaya: which I thought was ok but tested it locally and am beginning to think it is not going to work as expected23:13
clarkbhrm it works in some cases and not in others23:14
anteayaclarkb: ah okay23:14
clarkboh wait I might just be derping23:14
clarkbthis is why I ask other people :)23:14
fungiclarkb: indented assignments seem to work fine for me23:14
clarkbyup I see the pebkac in my test script23:14
fungiand in fact i rely on them quite frequently23:14
clarkbfungi: thank you for confirming23:14
mtreinishcorvus: just hit a new exception on gertty: http://paste.openstack.org/show/542188/23:15
fungito, you know, make shell scripts readable23:15
anteayaclarkb: the heredoc was changed in response to ianw's comment on patchset one23:15
clarkbwe write so much python its easy to think that whitespace matters in other langs23:15
mtreinishalthough that might just be related to the new project creation going on around the same time as a sync23:15
anteayaclarkb: it is a good question23:15
clarkbmy other concern with this is its a fairly rich rewrite that is all going to go away when zuulv3 happens23:16
clarkbbut they already did the work so no going back now23:16
*** rbuzatu has quit IRC23:16
anteayait is a rich rewrite agreed23:16
anteayahowever the current state of the ironic tests is the worst of any other in the project-config repo, in my opinon23:17
*** kaisers_ has joined #openstack-infra23:17
clarkbanteaya: they have a lot of them and don't use them all. This addresses the extra jobs by removing them which is nice23:17
anteayayes23:18
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Temporary fix for nodejs/libuv conflict  https://review.openstack.org/34756523:18
anteayayay jobs that are used23:18
*** hongbin has quit IRC23:18
*** salv-orl_ has joined #openstack-infra23:18
anteayaI think the state of how they were written had hindered cleanup prior to now23:18
anteayapersonal opinion23:18
*** esberglu has joined #openstack-infra23:18
corvusmtreinish: yeah, my guess is that's gertty not noticing the new projcet -- it only syncs projects at startup23:18
corvusmtreinish: i bet we can handle that.  i also bet if you restart gertty it should work23:19
*** signed8bit is now known as signed8bit_Zzz23:19
mtreinishyeah, I suspect that is the case23:19
*** csomerville has joined #openstack-infra23:20
clarkbanteaya: jroll its also probably worthwhile talking about whether or not we need to test all these combos with all these tests or maybe a bunch of it can be shoved into a functional type test then cover integration testing with a smaller set of jobs23:21
clarkbbecause I think what happens is we have a new job for every single possible deployment scenario for ironic right now23:21
*** salv-orlando has quit IRC23:21
anteayaclarkb: sure, did we want to have that chat prior to merging this?23:21
anteayaclarkb: yes, I think that is an accurate assessment23:22
clarkbanteaya: no I think that can happen further down the line as this is an improvement over what we haev today23:22
*** kaisers_ has quit IRC23:22
*** ddieterly has joined #openstack-infra23:22
anteayaagreed, it is an improvement23:22
*** rbuzatu has joined #openstack-infra23:23
*** esberglu has quit IRC23:23
aspierscorvus: is there a way to build a man page for gertty? or it hasn't been written yet?23:23
clarkbfor example I seriously doubt we need to test multiple ipa images. We only need one...23:23
*** cody-somerville has quit IRC23:24
anteayaI wonder if this cleanup will make the what should be tested conversation more accessible23:24
mtreinishaspiers: sphinx can build a man page23:24
anteayait has been an append to mass for some time now, I don't think job composers even looked at what was already there too closely23:25
pabelangerfungi: apologies for bailing on the meeting at the last minute.  I had to step away for a personal matter which turned into a few hours away from the computer.23:25
*** esberglu has joined #openstack-infra23:25
anteayapabelanger: I hope everything is okay23:25
*** sarob has quit IRC23:26
fungipabelanger: no worries. i kept your topic on the agenda for next week. feel free to remove it if you plan to just cover it before then23:26
*** mriedem has quit IRC23:26
fungianteaya: surprisingly, this is my first time trying to create a poll in civs. i haven't seen anywhere to add voter addresses for a private poll23:26
mtreinishaspiers: I ran 'tox -evenv -- sphinx-build -b man doc/source doc/man' from the repo root and it dumped the man page in doc/man/gertty.123:26
anteayaah okay let me look23:27
aspiersmtreinish: cool, thanks!23:27
*** rbuzatu has quit IRC23:27
*** hashar has quit IRC23:27
anteayafungi: I'm certain you went through the faqs: http://www.cs.cornell.edu/w8/~andru/civs/faq.html23:28
*** sarob has joined #openstack-infra23:28
fungianteaya: yep, reading through them as we speak23:28
fungijust amused by the unintuitive nature of that part of the interface23:28
clarkbactually I think I take it back about this removing unused jobs. https://review.openstack.org/#/c/340567/2/jenkins/jobs/projects.yaml does a full cross product on those params23:28
pabelangerfungi: thanks23:28
clarkbI think23:28
pabelangeranteaya: Yup, all good now.23:28
anteayapabelanger: good to hear23:28
anteayafungi: okay so you should see somewhere where you can upload a file23:29
mtreinishfungi: I'm always surprised we haven't started our own civs instance somewhere in infra, especially considering how much we use it23:29
*** thorst has quit IRC23:29
anteayafungi: failing that you can add them (manually I think) after you start the poll: https://wiki.openstack.org/wiki/Election_Officiating_Guidelines#Run_the_Election23:29
mordredfungi: the thing that might not jump out at you is that you add addresses after you "start the poll"23:29
clarkbunless jjb's exclude thing is new magic there23:29
anteayabut let me create a fake poll and see if I can find the upload feature23:29
mordredfungi: ah, as anteaya said23:29
*** esberglu has quit IRC23:29
*** thorst has joined #openstack-infra23:29
fungianteaya: mordred: yep, the faqs are also unclear on that part of the process23:30
mordredfungi: so - you create a poll and click the button, it will then email you an admin link23:30
mordredfungi: once you go to the admin link, you can add people, and also start the poll23:30
mordredit is not clear what happens if you add people and then start hte poll23:30
mordredI always start the poll then add people23:30
fungigot that far. i'm on the poll control page now, all i saw options for were starting the poll, editing the description, and loading ballot data23:30
clarkbhuh exclude is jjb magic23:31
fungieven after starting the poll the only other difference is that i have an option to end the poll instead23:31
clarkbwhich means you can't have a parameter called exclude23:31
fungii'll look at our civs docs23:31
mordredfungi: you do not see a section at the bottom of the page titled "Add voters" ?23:31
fungimordred: nope, note whatsoever23:32
*** ddieterly is now known as ddieterly[away]23:32
mordredfungi: fascinating. you are sure you selected private poll23:32
mordred?23:32
*** sarob has quit IRC23:33
fungii was sure i selected private but i don't see any indication in the poll control page that it is either private or public23:33
anteayafungi: looks like you have to start the poll to get the option to upload the voters file23:33
mordredfungi: yah - I just made one real quick and I have an "add voters" section23:33
fungialso it says "this is a test poll" in the options23:33
anteayafungi: this is a new feature, I used to be able to load the voters when creating the initial poll, I'm pretty sure23:33
mordredfungi: oh - did you select "make this a test poll"?23:33
fungimaybe i accidentally checked a checkbox i shouldn't have23:33
mordredyah23:33
fungii'll start over23:34
mordreddon't check that checkbox - that only works if you're going to also upload results23:34
mordredfungi: here is the admin page for the silly poll I just made in case it's helpful: http://civs.cs.cornell.edu/cgi-bin/control.pl?id=E_945a24e1c3b90ff8&key=f207347c5b7381fa&akey=854ff03e804c832323:34
*** rbuzatu has joined #openstack-infra23:34
anteayafungi: here is my silly test poll admin page: http://civs.cs.cornell.edu/cgi-bin/control.pl?id=E_78d6b5043810e6b9&key=5dfa180ea8b52a4e&akey=f2bd087fd970606623:35
fungid'oh! i did check "Make this a test poll: read all votes from a file."23:35
anteayaah ha23:35
mordredthat will do it23:35
fungithought it said "read all voters from a file"23:35
* fungi curses his dyslexia23:35
anteayaI'll add that to the wiki not do check that box23:35
mordredanteaya: ++23:35
clarkbjroll: JayF ok I think I am happy with https://review.openstack.org/#/c/340567 as is (we should keep iterating on that though because I think we can simplify further. eg ramdisk type, not sure we actually need to test all those combos if we have one that works)23:35
fungithat's the "this won't work" checkbox23:35
craigeo/23:36
craigeoh hey, there's only 10 days left to get your LCA2017 (Hobart, Tasmania!) talks in! https://linux.conf.au/proposals23:36
clarkbjroll: JayF: can I go ahead and approve 340567 now?23:36
mordredclarkb: oy23:36
mordredgah23:36
mordredcraige: oy23:36
mordredcraige: I need to get on that23:36
openstackgerritJames E. Blair proposed openstack/gertty: Create new projects automatically when syncing a change  https://review.openstack.org/34757823:37
corvusmtreinish: ^23:37
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Temporary fix for nodejs/libuv conflict  https://review.openstack.org/34756523:37
*** sarob has joined #openstack-infra23:37
anteayamordred: fungi can you review this wikipage and tell me if you think these instructions are current? https://wiki.openstack.org/wiki/Election_Officiating_Guidelines#Running_the_election_itself23:38
craige+1 mordred :-)23:38
*** thorst has quit IRC23:38
*** xarses has quit IRC23:38
*** baoli has quit IRC23:38
anteayacraige: thank you23:38
*** rbuzatu has quit IRC23:38
pabelangeranteaya: left a comment on 347525 along with +223:38
craigeYou're welcome anteaya :-)23:38
anteayacraige: the deadline approachth23:38
anteayapabelanger: thank you23:39
anteayacraige: :)23:39
fungimordred: anteaya: "Sorry, voters can only be added to an poll in progress." (so i guess you really do have to start it first)23:39
*** zz_dimtruck is now known as dimtruck23:40
anteayafungi: sigh, I swear I used to be able to add voters when creating the initial poll, before I finished filling out the first form23:40
anteayanow I could only add the first 100023:40
aspiersmtreinish: that sphinx-build command only works for me within a git checkout, not within a package build from the .tar.gz23:40
anteayabut still I was sure I could23:40
fungianteaya: it's possible they've changed it subtly23:40
anteayafungi: seems so23:40
aspiersmtreinish: it gives Exception: Versioning for this project requires either an sdist tarball, or access to an upstream git repository. Are you sure that git is installed?23:41
pabelangerclarkb: are we ready to start moving more jobs to ubuntu-xenial?  For example, the gate-{name}-linters jobs23:41
aspiersI don't know why it wouldn't consider https://files.pythonhosted.org/packages/source/g/gertty/gertty-%{version}.tar.gz as an sdist tarball23:41
fungiaspiers: you need the python packaging metadata or a git checkout to run setup.py (because it uses pbr)23:41
aspiersoh, so I need the .whl after all?23:42
fungiaspiers: but you may be able to avoid that by setting an envvar23:42
*** ddieterly[away] has quit IRC23:42
mtreinishcorvus: that lgtm, but I can't really test it anymore23:42
fungiaspiers: sdist tarball, not wheel23:42
aspiersdoesn't that URL contain an sdist tarball?23:42
mtreinishfungi: there is no setup.py being invoked from the cli, calling build_sphinx directly. My guess is it's coming from pbr versioning23:42
aspiersmtreinish: your guess is correct23:43
fungiaspiers: oh, are you using the tarball from that url? then yes23:43
mtreinishiirc, there should be an env var you set to avoid that23:43
aspiers  File "/usr/lib/python2.7/site-packages/pbr/version.py", line 447, in _get_version_from_pkg_resources23:43
aspiers    result_string = packaging.get_version(self.package)23:43
mtreinishoh, fungi already said that23:43
aspiers  File "/usr/lib/python2.7/site-packages/pbr/packaging.py", line 725, in get_version23:43
aspiersto avoid pbr trying to get the version?23:43
*** rbuzatu has joined #openstack-infra23:43
aspiersPBR_VERSION?23:44
fungimtreinish: aspiers: that said, i've been meaning for a while to hack on an improvement to pbr so that sdist (and maybe bdist_wheel) can call build_sphinx doc/man23:44
fungiand then bundle the resulting manpage(s)23:45
*** rbuzatu_ has joined #openstack-infra23:45
openstackgerritAnita Kuno proposed openstack-infra/project-config: Remove bluebox  https://review.openstack.org/34757923:45
fungiaspiers: yeah, you could just export PBR_VERSION=1.4.023:45
aspiersfungi: you mean like http://stackoverflow.com/a/22273180/179332 ?23:45
pleia2fungi: woo, poll, thanks :)23:45
aspiersfungi: right - testing that now23:45
*** yuanying has joined #openstack-infra23:45
fungipleia2: glad it's working!23:46
*** sarob has quit IRC23:46
*** sarob has joined #openstack-infra23:46
fungiaspiers: i haven't tried it in exactly the conditions you're describing so not certain that'll work around it23:46
fungibut worth a shot23:46
anteayapabelanger: here is the change you requested: https://review.openstack.org/#/c/347579/123:47
*** tonytan4ever has quit IRC23:47
anteayapabelanger: now I can't seem to see the revert button23:47
anteayaI swear we used to have a revert button, I have used it in the past23:47
pabelangercorvus: I've been using status.o.o/zuul a fair bit over the last few days and noticed our elapsed time estimates don't always appear correct.  I am wondering if our sample size window of last 10 jobs might be too small? I was thinking maybe upping the count to 50 to increase the sample range23:47
pabelangeranteaya: perfect!23:47
anteayapabelanger: okay great, thank you23:48
fungiTotal of 798 voters authorized to vote.23:48
fungipoll sent23:48
clarkbanteaya: the button is on merged changes in the box around where you reply23:48
anteayapabelanger: any pointers on where the revert button has disappeared to?23:48
pabelangeranteaya: Hmm, I wonder if the button is only exposed after the code is merged23:48
fungianteaya: pabelanger: yes, i don't think gerrit lets you revert open changes23:48
pabelangeranteaya: you could run it locally using: git revert c1106775914bceb04a1c8f54e12e024d71d1303723:48
anteayayeah I got cherry-pick, rebase, abandon and follow up23:48
pabelangeranteaya: I believe that is the correct syntax23:48
anteayafungi: ah thanks23:49
anteayapabelanger: thanks, I'll try that23:49
fungias pabelanger says you can git revert locally, commit --amend and then review23:49
*** rbuzatu has quit IRC23:49
fungithe commit --amend is necessary so that the gerrit hook to add a change-id to teh commit message fires23:49
fungisince those hooks aren't called by revert23:50
pabelangerah, right23:50
pabelangerforgot about that23:50
fungi(or pretty much any other commit-generating git command besides commit itself)23:50
aspiersmtreinish, fungi: PBR_VERSION worked23:50
*** rbuzatu_ has quit IRC23:50
fungiaspiers: good to know that's viable when calling sphinx outside setup.py as well23:50
openstackgerritAnita Kuno proposed openstack-infra/project-config: Revert "Remove bluebox"  https://review.openstack.org/34758023:50
mordredfungi: I have voted23:50
anteayapabelanger: fungi thank you23:50
aspiersfungi: in the rpm build environment I actually had to ditch the tox -evenv too23:51
fungiaspiers: oh, sure i missed you were doing packaging23:51
prometheanfirecoted23:51
clarkbif we vote for the coconut palm do we put the next midcycle in fungis backyard under the palms?23:51
prometheanfirevoted23:51
fungiaspiers: that envvar was added specifically to make distro packagers lives easier23:51
anteayaclarkb: hawaiian shirts for everyone23:52
prometheanfirewhich envar?23:52
fungiclarkb: my palmettos are very short. you could sit under them, but it wouldn't be comfortable23:52
fungialso palmetto bugs23:52
*** dingyichen has joined #openstack-infra23:52
fungiprometheanfire: PBR_VERSION23:52
*** shashank_hegde has quit IRC23:52
*** rockyg has joined #openstack-infra23:52
prometheanfireah23:52
aspiersfungi: glad to know it achieved its aim :)23:52
*** pvaneck has quit IRC23:53
fungiclarkb: it's on my to do list to stary training them upward when it comes time to prune all teh shrubs this winter23:53
prometheanfirerequirements came up with beaver as well, and ant, and bee23:53
fungis/stary/start/23:53
*** pvaneck has joined #openstack-infra23:53
*** caowei has joined #openstack-infra23:53
anteayaI want to know more about racoon dogs23:54
clarkbwhatever you do don't feed the racoons23:54
*** nwkarsten has quit IRC23:54
clarkbone time I faced off against a racoon with a broom. Pretty sure it won23:54
*** pvaneck has quit IRC23:54
anteayathey can be vicious when cornered23:54
fungiprometheanfire: yep, they're all popular options across multiple teams. luckily condorcet ranking is a great way to handle that. we give the resulting ranked list to heidijoy and she'll mark off the ones we can't use and then the top one left standing is our best bet23:54
*** pvaneck has joined #openstack-infra23:54
anteayaas can beavers23:54
anteayacame across a beaver in a field23:55
*** nwkarsten has joined #openstack-infra23:55
anteayawow, did it put on a stance23:55
fungianteaya: the wikipedia article on tanuki has some good cultural references23:55
anteayafortunately my dog was well trained and heeded my voice commands so we just left it at posturing23:55
mtreinishfungi: fwiw, I use sphinx outside of setup.py all the time. (it's how you build things like: http://blog.kortar.org/wp-content/uploads/2015/07/Nova3.pdf since no one bakes latex into conf.py)23:55
prometheanfireyep23:55
anteayafungi: I'm reading it23:55
mtreinishI've just never done it outside of the git repo23:55
prometheanfireI think tonyb is going to set up that poll for us23:55
jlkare there photos anywhere of the potential mascotts?23:56
fungijlk: wikipedia?23:56
tonybprometheanfire: say what now?23:56
jlkah, okay so these are specific images to vote on, just general ideas?23:56
*** rbuzatu has joined #openstack-infra23:56
anteayawell the absentminded part is correct23:56
anteayaI can't remember people I met last week23:56
fungijlk: right, context is http://lists.openstack.org/pipermail/openstack-dev/2016-July/099046.html23:57
clarkbjlk: correct, one we have a preference the illustators willw hip up the final design23:57
anteayaor anything anyone told me yesterday23:57
prometheanfiretonyb: thanks23:57
clarkbheh vampire squid aka cthulu23:57
anteayaha ha ha23:57
*** sarob has quit IRC23:57
*** signed8bit_Zzz is now known as signed8bit23:58
anteayaI think neutron had spider web in their poll23:58
anteayaarmax: has neutron finished their mascot voting?23:58
pleia2big fan of the coelacanth23:58
fungiclarkb: vampire squid are pretty weird looking23:58
anteayapleia2: what is that?23:58
clarkbits a dinosaur fish23:59
fungiwell, sort of23:59
pleia2anteaya: a fish that was once thought long extinct, but it's not23:59
armaxanteaya: I was going to give it an extra few hours23:59
anteayaif beaver|woodchuck wins will it be beaver or woodchuck23:59
armaxwe had 60+ votes so far23:59
*** nwkarsten has quit IRC23:59
anteayapleia2: that is symbolic23:59
clarkbthey though it was extinct until 50 years ago when some local fishermen in madagascar put them in the market23:59
clarkbiirc23:59
anteayaarmax: cool23:59
anteayaclarkb: how do they taste?23:59
clarkbanteaya: I have no idea23:59
fungianteaya: i think it can be either beaver/woodchuck. they're the same animal23:59
pleia2haha23:59
*** rockyg has quit IRC23:59
*** rossella_s has quit IRC23:59
anteayafungi: no23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!