| *** atarakt has joined #openstack-infra | 00:00 | |
| *** Guest6666 has joined #openstack-infra | 00:00 | |
| *** njohnston has joined #openstack-infra | 00:00 | |
| *** andreykurilin has joined #openstack-infra | 00:00 | |
| *** Anticimex has joined #openstack-infra | 00:00 | |
| *** SpamapS has joined #openstack-infra | 00:00 | |
| *** honza has joined #openstack-infra | 00:00 | |
| *** Vivek has joined #openstack-infra | 00:00 | |
| *** smcginnis has joined #openstack-infra | 00:00 | |
| *** zerick has joined #openstack-infra | 00:00 | |
| *** loquacities has joined #openstack-infra | 00:00 | |
| *** szaher has joined #openstack-infra | 00:00 | |
| *** yuval has joined #openstack-infra | 00:00 | |
| *** charz has joined #openstack-infra | 00:00 | |
| *** sc` has joined #openstack-infra | 00:00 | |
| *** eeiden has joined #openstack-infra | 00:00 | |
| *** patriciadomin has joined #openstack-infra | 00:00 | |
| *** beagles has joined #openstack-infra | 00:00 | |
| *** ajafo has joined #openstack-infra | 00:00 | |
| *** hemanthm has joined #openstack-infra | 00:00 | |
| *** rcarrillocruz has joined #openstack-infra | 00:00 | |
| *** bauzas_afk has joined #openstack-infra | 00:00 | |
| *** michaelxin has joined #openstack-infra | 00:00 | |
| *** jesusaur has joined #openstack-infra | 00:00 | |
| *** mtreinish has joined #openstack-infra | 00:00 | |
| *** gtmanfred has joined #openstack-infra | 00:00 | |
| *** pabelanger has joined #openstack-infra | 00:00 | |
| *** jrich has joined #openstack-infra | 00:00 | |
| *** ianychoi has joined #openstack-infra | 00:00 | |
| *** cinerama` has joined #openstack-infra | 00:00 | |
| *** jogo has joined #openstack-infra | 00:00 | |
| *** abelur_ has joined #openstack-infra | 00:00 | |
| *** jaosorior has joined #openstack-infra | 00:00 | |
| *** funzo has joined #openstack-infra | 00:00 | |
| *** katyafervent_awa has joined #openstack-infra | 00:00 | |
| *** dteselkin has joined #openstack-infra | 00:00 | |
| *** rtjure has joined #openstack-infra | 00:00 | |
| *** ggherdov- has joined #openstack-infra | 00:00 | |
| *** mrmartin has joined #openstack-infra | 00:00 | |
| *** jcook has joined #openstack-infra | 00:00 | |
| *** edwarnicke has joined #openstack-infra | 00:00 | |
| *** arxcruz has joined #openstack-infra | 00:00 | |
| *** csatari has joined #openstack-infra | 00:00 | |
| *** hughsaunders has joined #openstack-infra | 00:00 | |
| *** zz_ja has joined #openstack-infra | 00:00 | |
| *** numans has joined #openstack-infra | 00:00 | |
| *** wendar has joined #openstack-infra | 00:00 | |
| *** yolanda has joined #openstack-infra | 00:00 | |
| *** markmcd has joined #openstack-infra | 00:00 | |
| *** zzzeek has joined #openstack-infra | 00:00 | |
| *** openstackgerrit has joined #openstack-infra | 00:00 | |
| *** jangutter has joined #openstack-infra | 00:00 | |
| *** dmsimard|off has joined #openstack-infra | 00:00 | |
| *** dham1 has joined #openstack-infra | 00:00 | |
| *** neith has joined #openstack-infra | 00:00 | |
| *** jamespage has joined #openstack-infra | 00:00 | |
| *** auggy has joined #openstack-infra | 00:00 | |
| *** jbryce has joined #openstack-infra | 00:00 | |
| *** kmalloc has joined #openstack-infra | 00:00 | |
| *** kmARC has joined #openstack-infra | 00:00 | |
| *** briancurtin has joined #openstack-infra | 00:00 | |
| *** DuncanT has joined #openstack-infra | 00:00 | |
| *** jd_ has joined #openstack-infra | 00:00 | |
| *** puiterwijk|cld has joined #openstack-infra | 00:00 | |
| *** mdrabe has joined #openstack-infra | 00:00 | |
| *** quite has joined #openstack-infra | 00:00 | |
| *** flwang has joined #openstack-infra | 00:00 | |
| *** jkilpatr has joined #openstack-infra | 00:00 | |
| *** khappone has joined #openstack-infra | 00:00 | |
| *** jklare has joined #openstack-infra | 00:00 | |
| *** lennyb has joined #openstack-infra | 00:00 | |
| *** mordred has joined #openstack-infra | 00:00 | |
| *** onovy has joined #openstack-infra | 00:00 | |
| *** ekhugen has joined #openstack-infra | 00:00 | |
| *** mpjetta has joined #openstack-infra | 00:00 | |
| *** dtroyer has joined #openstack-infra | 00:00 | |
| *** watersoul has joined #openstack-infra | 00:00 | |
| *** therve has joined #openstack-infra | 00:00 | |
| *** afazekas has joined #openstack-infra | 00:00 | |
| *** bmjen has joined #openstack-infra | 00:00 | |
| *** luzC has joined #openstack-infra | 00:00 | |
| *** Gorian has joined #openstack-infra | 00:00 | |
| *** pbourke has joined #openstack-infra | 00:00 | |
| *** dhill_ has joined #openstack-infra | 00:00 | |
| *** gibi has joined #openstack-infra | 00:00 | |
| *** gouthamr has joined #openstack-infra | 00:00 | |
| *** yamamoto has joined #openstack-infra | 00:00 | |
| *** lin_yang has joined #openstack-infra | 00:00 | |
| *** Apoorva_ has joined #openstack-infra | 00:00 | |
| *** lewo has joined #openstack-infra | 00:00 | |
| *** d0ugal has joined #openstack-infra | 00:00 | |
| *** armax has joined #openstack-infra | 00:00 | |
| *** jamesden_ has joined #openstack-infra | 00:00 | |
| *** kjackal_ has joined #openstack-infra | 00:00 | |
| *** annegentle has joined #openstack-infra | 00:00 | |
| *** sshnaidm|off has joined #openstack-infra | 00:00 | |
| *** rybridges has joined #openstack-infra | 00:00 | |
| *** yamahata has joined #openstack-infra | 00:00 | |
| *** Julien-zte has joined #openstack-infra | 00:00 | |
| *** Guest80741 has joined #openstack-infra | 00:00 | |
| *** chlong_ has joined #openstack-infra | 00:00 | |
| *** david-lyle has joined #openstack-infra | 00:00 | |
| *** caphrim007 has joined #openstack-infra | 00:00 | |
| *** esberglu has joined #openstack-infra | 00:00 | |
| *** jcoufal has joined #openstack-infra | 00:00 | |
| *** krtaylor has joined #openstack-infra | 00:00 | |
| *** slagle has joined #openstack-infra | 00:00 | |
| *** HeOS has joined #openstack-infra | 00:00 | |
| *** flaper87 has joined #openstack-infra | 00:00 | |
| *** AJaeger has joined #openstack-infra | 00:00 | |
| *** rwsu has joined #openstack-infra | 00:00 | |
| *** Dinesh_Bhor has joined #openstack-infra | 00:00 | |
| *** arturb has joined #openstack-infra | 00:00 | |
| *** tnarg has joined #openstack-infra | 00:00 | |
| *** aeng has joined #openstack-infra | 00:00 | |
| *** sflanigan has joined #openstack-infra | 00:00 | |
| *** panda has joined #openstack-infra | 00:00 | |
| *** jrist has joined #openstack-infra | 00:00 | |
| *** Jeffrey4l has joined #openstack-infra | 00:00 | |
| *** lathiat has joined #openstack-infra | 00:00 | |
| *** mandre has joined #openstack-infra | 00:00 | |
| *** akscram has joined #openstack-infra | 00:00 | |
| *** peterlisak has joined #openstack-infra | 00:00 | |
| *** pcrews has joined #openstack-infra | 00:00 | |
| *** makowals has joined #openstack-infra | 00:00 | |
| *** vipul has joined #openstack-infra | 00:00 | |
| *** spiffxp has joined #openstack-infra | 00:00 | |
| *** kuromagi has joined #openstack-infra | 00:00 | |
| *** tinwood has joined #openstack-infra | 00:00 | |
| *** calebb has joined #openstack-infra | 00:00 | |
| *** efried_zzz has joined #openstack-infra | 00:00 | |
| *** GregHouse has joined #openstack-infra | 00:00 | |
| *** niska has joined #openstack-infra | 00:00 | |
| *** apetrich has joined #openstack-infra | 00:00 | |
| *** bswartz has joined #openstack-infra | 00:00 | |
| *** lihi has joined #openstack-infra | 00:00 | |
| *** oanson has joined #openstack-infra | 00:00 | |
| *** Hunner has joined #openstack-infra | 00:00 | |
| *** mwhahaha has joined #openstack-infra | 00:00 | |
| *** betherly has joined #openstack-infra | 00:00 | |
| *** simonmcc has joined #openstack-infra | 00:00 | |
| *** fdegir has joined #openstack-infra | 00:00 | |
| *** TheJulia has joined #openstack-infra | 00:00 | |
| *** berendt has joined #openstack-infra | 00:00 | |
| *** rockstar has joined #openstack-infra | 00:00 | |
| *** Douhet has joined #openstack-infra | 00:00 | |
| *** benj_ has joined #openstack-infra | 00:00 | |
| *** thorre has joined #openstack-infra | 00:00 | |
| *** hamzy has joined #openstack-infra | 00:00 | |
| *** spligak has joined #openstack-infra | 00:00 | |
| *** kzaitsev1pi has joined #openstack-infra | 00:00 | |
| *** jistr|off has joined #openstack-infra | 00:00 | |
| *** lifeless_ has joined #openstack-infra | 00:00 | |
| *** portdirect has joined #openstack-infra | 00:00 | |
| *** junbo has joined #openstack-infra | 00:00 | |
| *** adriant has joined #openstack-infra | 00:00 | |
| *** Nil_ has joined #openstack-infra | 00:00 | |
| *** mjblack has joined #openstack-infra | 00:00 | |
| *** Diabelko has joined #openstack-infra | 00:00 | |
| *** Adri2000 has joined #openstack-infra | 00:00 | |
| *** ssbarnea has joined #openstack-infra | 00:00 | |
| *** inc0 has joined #openstack-infra | 00:00 | |
| *** mattoliverau has joined #openstack-infra | 00:00 | |
| *** abelur has joined #openstack-infra | 00:00 | |
| *** DinaBelova has joined #openstack-infra | 00:00 | |
| *** filler has joined #openstack-infra | 00:00 | |
| *** otherwiseguy has joined #openstack-infra | 00:00 | |
| *** pahuang has joined #openstack-infra | 00:00 | |
| *** ianw has joined #openstack-infra | 00:00 | |
| *** russellb has joined #openstack-infra | 00:00 | |
| *** niedbalski has joined #openstack-infra | 00:00 | |
| *** SergeyLukjanov has joined #openstack-infra | 00:00 | |
| *** logan- has joined #openstack-infra | 00:00 | |
| *** rbergeron has joined #openstack-infra | 00:00 | |
| *** rakhmerov has joined #openstack-infra | 00:00 | |
| *** larainema has joined #openstack-infra | 00:00 | |
| *** jmorgan1 has joined #openstack-infra | 00:00 | |
| *** ggillies has joined #openstack-infra | 00:00 | |
| *** mpranjic has joined #openstack-infra | 00:00 | |
| *** odyssey4me has joined #openstack-infra | 00:00 | |
| *** Odd_Bloke has joined #openstack-infra | 00:00 | |
| *** ruhe has joined #openstack-infra | 00:00 | |
| *** aarefiev_afk has joined #openstack-infra | 00:00 | |
| *** stevebaker has joined #openstack-infra | 00:00 | |
| *** fbouliane has joined #openstack-infra | 00:00 | |
| *** rodrigods has joined #openstack-infra | 00:00 | |
| *** larsks has joined #openstack-infra | 00:00 | |
| *** beisner has joined #openstack-infra | 00:00 | |
| *** Qiming has joined #openstack-infra | 00:00 | |
| *** raissa has joined #openstack-infra | 00:00 | |
| *** liusheng has joined #openstack-infra | 00:00 | |
| *** mnaser has joined #openstack-infra | 00:00 | |
| *** olaph has joined #openstack-infra | 00:00 | |
| *** serverascode has joined #openstack-infra | 00:00 | |
| *** isviridoz has joined #openstack-infra | 00:00 | |
| *** fabo has joined #openstack-infra | 00:00 | |
| *** weshay has joined #openstack-infra | 00:00 | |
| *** asettle has joined #openstack-infra | 00:00 | |
| *** dutsmoc has joined #openstack-infra | 00:00 | |
| *** sdake has joined #openstack-infra | 00:00 | |
| *** robled has joined #openstack-infra | 00:00 | |
| *** Nakato has joined #openstack-infra | 00:00 | |
| *** cloudnull has joined #openstack-infra | 00:00 | |
| *** mnencia has joined #openstack-infra | 00:00 | |
| *** bstinson has joined #openstack-infra | 00:00 | |
| *** arif-ali has joined #openstack-infra | 00:00 | |
| *** markmcclain has joined #openstack-infra | 00:00 | |
| *** deduped has joined #openstack-infra | 00:00 | |
| *** sambetts|afk has joined #openstack-infra | 00:00 | |
| *** reed has joined #openstack-infra | 00:00 | |
| *** adam_g has joined #openstack-infra | 00:00 | |
| *** sai has joined #openstack-infra | 00:00 | |
| *** isq_ has joined #openstack-infra | 00:00 | |
| *** danpawlik has joined #openstack-infra | 00:00 | |
| *** oomichi has joined #openstack-infra | 00:00 | |
| *** masber has joined #openstack-infra | 00:00 | |
| *** mrunge has joined #openstack-infra | 00:00 | |
| *** fmccrthy has joined #openstack-infra | 00:00 | |
| *** dosaboy has joined #openstack-infra | 00:00 | |
| *** dims has joined #openstack-infra | 00:00 | |
| *** robcresswell has joined #openstack-infra | 00:00 | |
| *** seongsoocho has joined #openstack-infra | 00:00 | |
| *** pfallenop has joined #openstack-infra | 00:00 | |
| *** kaisers2 has joined #openstack-infra | 00:00 | |
| *** thingee has joined #openstack-infra | 00:00 | |
| *** zer0c00l_ has joined #openstack-infra | 00:00 | |
| *** srwilkers_ has joined #openstack-infra | 00:00 | |
| *** zeus has joined #openstack-infra | 00:00 | |
| *** vponomaryov has joined #openstack-infra | 00:00 | |
| *** mugsie has joined #openstack-infra | 00:00 | |
| *** clarkb has joined #openstack-infra | 00:00 | |
| *** eglute has joined #openstack-infra | 00:00 | |
| *** d34dh0r53 has joined #openstack-infra | 00:00 | |
| *** dhellmann has joined #openstack-infra | 00:00 | |
| *** rvba has joined #openstack-infra | 00:00 | |
| *** uberjay has joined #openstack-infra | 00:00 | |
| *** anthonyper has joined #openstack-infra | 00:00 | |
| *** yuanying has joined #openstack-infra | 00:00 | |
| *** bradm has joined #openstack-infra | 00:00 | |
| *** med_ has joined #openstack-infra | 00:00 | |
| *** jmccrory has joined #openstack-infra | 00:00 | |
| *** gorba_ has joined #openstack-infra | 00:00 | |
| *** notmyname has joined #openstack-infra | 00:00 | |
| *** lucas-afk has joined #openstack-infra | 00:00 | |
| *** wfoster has joined #openstack-infra | 00:00 | |
| *** jamielennox has joined #openstack-infra | 00:00 | |
| *** tristanC has joined #openstack-infra | 00:00 | |
| *** yankcrime has joined #openstack-infra | 00:00 | |
| *** rhagarty has joined #openstack-infra | 00:00 | |
| *** timburke has joined #openstack-infra | 00:00 | |
| *** gaurangt has joined #openstack-infra | 00:00 | |
| *** Kevin_Zheng has joined #openstack-infra | 00:00 | |
| *** zaneb has joined #openstack-infra | 00:00 | |
| *** andreaf has joined #openstack-infra | 00:00 | |
| *** mika has joined #openstack-infra | 00:00 | |
| *** cburgess has joined #openstack-infra | 00:00 | |
| *** kong has joined #openstack-infra | 00:00 | |
| *** jbernard has joined #openstack-infra | 00:00 | |
| *** alex_xu has joined #openstack-infra | 00:00 | |
| *** Shrews has joined #openstack-infra | 00:00 | |
| *** greghaynes has joined #openstack-infra | 00:00 | |
| *** vaidy has joined #openstack-infra | 00:00 | |
| *** petevg has joined #openstack-infra | 00:00 | |
| *** antonym has joined #openstack-infra | 00:00 | |
| *** tdasilva has joined #openstack-infra | 00:00 | |
| *** toabctl has joined #openstack-infra | 00:00 | |
| *** mancdaz has joined #openstack-infra | 00:00 | |
| *** freerunner has joined #openstack-infra | 00:00 | |
| *** hogepodge has joined #openstack-infra | 00:00 | |
| *** zxiiro has joined #openstack-infra | 00:00 | |
| *** madhuvishy has joined #openstack-infra | 00:00 | |
| *** scottda has joined #openstack-infra | 00:00 | |
| *** coreycb has joined #openstack-infra | 00:00 | |
| *** dirk has joined #openstack-infra | 00:00 | |
| *** patrickeast has joined #openstack-infra | 00:00 | |
| *** ildikov has joined #openstack-infra | 00:00 | |
| *** mgkwill has joined #openstack-infra | 00:00 | |
| *** samueldmq has joined #openstack-infra | 00:00 | |
| *** ameade has joined #openstack-infra | 00:00 | |
| *** clayg has joined #openstack-infra | 00:00 | |
| *** fenar has joined #openstack-infra | 00:00 | |
| *** xgerman_ has joined #openstack-infra | 00:00 | |
| *** SotK has joined #openstack-infra | 00:00 | |
| *** kklimonda has joined #openstack-infra | 00:00 | |
| *** knikolla has joined #openstack-infra | 00:00 | |
| *** tbarron has joined #openstack-infra | 00:00 | |
| *** cmurphy has joined #openstack-infra | 00:00 | |
| *** dtantsur|afk has joined #openstack-infra | 00:00 | |
| *** zaro has joined #openstack-infra | 00:00 | |
| *** cargonza has joined #openstack-infra | 00:00 | |
| *** srwilkers has joined #openstack-infra | 00:00 | |
| *** tommylikehu has joined #openstack-infra | 00:00 | |
| *** geekinutah has joined #openstack-infra | 00:00 | |
| *** Swimingly has joined #openstack-infra | 00:00 | |
| *** jeblair has joined #openstack-infra | 00:00 | |
| *** verdurin has joined #openstack-infra | 00:00 | |
| *** puiterwijk has joined #openstack-infra | 00:00 | |
| *** dgonzalez has joined #openstack-infra | 00:00 | |
| *** vkmc has joined #openstack-infra | 00:00 | |
| *** rfolco has joined #openstack-infra | 00:00 | |
| *** melwitt has joined #openstack-infra | 00:00 | |
| *** hrybacki has joined #openstack-infra | 00:00 | |
| *** v1k0d3n has joined #openstack-infra | 00:00 | |
| *** zhenguo has joined #openstack-infra | 00:00 | |
| *** tonyb has joined #openstack-infra | 00:00 | |
| *** mhayden has joined #openstack-infra | 00:00 | |
| *** sulo has joined #openstack-infra | 00:00 | |
| *** mrodden has joined #openstack-infra | 00:00 | |
| *** schang has joined #openstack-infra | 00:00 | |
| *** ttx has joined #openstack-infra | 00:00 | |
| *** masayukig has joined #openstack-infra | 00:00 | |
| *** johnthetubaguy has joined #openstack-infra | 00:00 | |
| *** Zara has joined #openstack-infra | 00:00 | |
| *** lamt has joined #openstack-infra | 00:00 | |
| *** ilpianista has joined #openstack-infra | 00:00 | |
| *** devananda has joined #openstack-infra | 00:00 | |
| *** petrovich has joined #openstack-infra | 00:00 | |
| *** eventingmonkey has joined #openstack-infra | 00:00 | |
| *** evgenyl has joined #openstack-infra | 00:00 | |
| *** andymccr has joined #openstack-infra | 00:00 | |
| *** wznoinsk has joined #openstack-infra | 00:00 | |
| *** NikitaKonovalov has joined #openstack-infra | 00:00 | |
| *** laurelm has joined #openstack-infra | 00:00 | |
| *** vgnbkr has joined #openstack-infra | 00:00 | |
| *** peterstac has joined #openstack-infra | 00:00 | |
| *** Keitaro has joined #openstack-infra | 00:00 | |
| *** asilenkov has joined #openstack-infra | 00:00 | |
| *** jlk has joined #openstack-infra | 00:00 | |
| *** timothyb89 has joined #openstack-infra | 00:00 | |
| *** dougshelley66 has joined #openstack-infra | 00:00 | |
| *** ericyoung has joined #openstack-infra | 00:00 | |
| *** bkero has joined #openstack-infra | 00:00 | |
| *** MasterofJOKers has joined #openstack-infra | 00:00 | |
| *** mmedvede has joined #openstack-infra | 00:00 | |
| *** mgagne has joined #openstack-infra | 00:00 | |
| *** StevenK has joined #openstack-infra | 00:00 | |
| *** kwazar has joined #openstack-infra | 00:00 | |
| *** EmilienM has joined #openstack-infra | 00:00 | |
| *** migi has joined #openstack-infra | 00:00 | |
| *** _ari_ has joined #openstack-infra | 00:00 | |
| *** gus has joined #openstack-infra | 00:00 | |
| *** gothicmindfood has joined #openstack-infra | 00:00 | |
| *** zigo has joined #openstack-infra | 00:00 | |
| *** fungi has joined #openstack-infra | 00:00 | |
| *** gaelL_ has joined #openstack-infra | 00:00 | |
| *** nhandler has joined #openstack-infra | 00:00 | |
| *** kencjohnston_ has joined #openstack-infra | 00:00 | |
| *** electrical has joined #openstack-infra | 00:00 | |
| *** rajinir has joined #openstack-infra | 00:00 | |
| *** andrewbogott has joined #openstack-infra | 00:00 | |
| *** rguillebert has joined #openstack-infra | 00:00 | |
| *** leifmadsen has joined #openstack-infra | 00:00 | |
| *** zeroDivisible has joined #openstack-infra | 00:00 | |
| *** davidlenwell has joined #openstack-infra | 00:00 | |
| *** tomhambleton_ has joined #openstack-infra | 00:00 | |
| *** bradjones has joined #openstack-infra | 00:00 | |
| *** ddurst has joined #openstack-infra | 00:00 | |
| *** zul has joined #openstack-infra | 00:00 | |
| *** sweston has joined #openstack-infra | 00:00 | |
| *** johnsom has joined #openstack-infra | 00:00 | |
| *** jpmaxman has joined #openstack-infra | 00:00 | |
| *** vdrok has joined #openstack-infra | 00:00 | |
| *** fkautz has joined #openstack-infra | 00:00 | |
| *** petems has joined #openstack-infra | 00:00 | |
| *** NobodyCam has joined #openstack-infra | 00:00 | |
| *** zhongjun has joined #openstack-infra | 00:00 | |
| *** pots has joined #openstack-infra | 00:00 | |
| *** Ng has joined #openstack-infra | 00:00 | |
| *** mrhillsman has joined #openstack-infra | 00:00 | |
| *** gus has quit IRC | 00:00 | |
| *** shu-mutou-AWAY has joined #openstack-infra | 00:00 | |
| *** ChanServ has joined #openstack-infra | 00:00 | |
| *** tepper.freenode.net sets mode: +o ChanServ | 00:00 | |
| *** rook has joined #openstack-infra | 00:00 | |
| *** rook has quit IRC | 00:00 | |
| *** rook has joined #openstack-infra | 00:00 | |
| *** markvoelker has quit IRC | 00:01 | |
| *** mudpuppy has joined #openstack-infra | 00:02 | |
| *** lastmikoi has joined #openstack-infra | 00:03 | |
| *** dulek has joined #openstack-infra | 00:03 | |
| *** kmalloc is now known as Guest11213 | 00:03 | |
| *** rook is now known as Guest52189 | 00:03 | |
| *** clayton has joined #openstack-infra | 00:04 | |
| *** rm_work has joined #openstack-infra | 00:04 | |
| *** stephenfin has joined #openstack-infra | 00:04 | |
| *** xarses has joined #openstack-infra | 00:04 | |
| *** trown has joined #openstack-infra | 00:04 | |
| *** pahuang has quit IRC | 00:04 | |
| *** xarses has quit IRC | 00:05 | |
| *** aviau has joined #openstack-infra | 00:05 | |
| *** sflanigan has quit IRC | 00:05 | |
| *** xarses has joined #openstack-infra | 00:05 | |
| *** Apoorva has joined #openstack-infra | 00:06 | |
| *** stevemar has joined #openstack-infra | 00:06 | |
| *** hemna has joined #openstack-infra | 00:07 | |
| *** raginbajin has joined #openstack-infra | 00:08 | |
| *** dizquierdo has quit IRC | 00:08 | |
| *** Apoorva_ has quit IRC | 00:09 | |
| *** masayukig[m] has joined #openstack-infra | 00:09 | |
| *** markvoelker has joined #openstack-infra | 00:10 | |
| *** baoli has joined #openstack-infra | 00:11 | |
| *** raginbajin has quit IRC | 00:11 | |
| *** dangers_away has quit IRC | 00:13 | |
| *** baoli has quit IRC | 00:15 | |
| *** dangers_away has joined #openstack-infra | 00:15 | |
| *** thorst has joined #openstack-infra | 00:16 | |
| *** raginbajin has joined #openstack-infra | 00:16 | |
| *** sflanigan has joined #openstack-infra | 00:18 | |
| *** sflanigan has joined #openstack-infra | 00:18 | |
| *** pahuang has joined #openstack-infra | 00:21 | |
| *** jamesmcarthur has joined #openstack-infra | 00:23 | |
| *** ilpianista_ has joined #openstack-infra | 00:23 | |
| *** lindsayk has joined #openstack-infra | 00:24 | |
| *** jamesmcarthur has quit IRC | 00:25 | |
| *** jamesmcarthur has joined #openstack-infra | 00:25 | |
| *** Apoorva has quit IRC | 00:29 | |
| *** jamesmcarthur has quit IRC | 00:29 | |
| *** Apoorva has joined #openstack-infra | 00:29 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Add netbase to ensure /etc/protocols is placed for debian https://review.openstack.org/490656 | 00:37 |
|---|---|---|
| clarkb | fungi: pabelanger thinking about debian, if package-deb is retired will we stop running debian test nodes? | 00:38 |
| *** jamesmcarthur has joined #openstack-infra | 00:39 | |
| fungi | clarkb: maybe? granted, we don't host gentoo or opensuse packaging in our ci system but still test tings on those platforms | 00:39 |
| clarkb | ya, but I don't think we ever ran any other jobs on debian right? | 00:40 |
| fungi | bindep... maybe dib? | 00:40 |
| clarkb | ah so there are a few | 00:40 |
| clarkb | ya I think dib does | 00:40 |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config master: Fix grafana configuration to neutron-dynamic-routing periodic job https://review.openstack.org/493709 | 00:41 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Adding new meeting for LCOO WG https://review.openstack.org/492220 | 00:41 |
| fungi | i wouldn't mind testing more stuff on debian, but worry that if i lobby to keep it around as a viable ci target i could be doing so out of personal preference | 00:41 |
| clarkb | most mirrors are done at this point | 00:42 |
| clarkb | lon1 is slow as is iad | 00:42 |
| clarkb | ovh is off so just getting it done | 00:43 |
| *** jamesmcarthur has quit IRC | 00:43 | |
| clarkb | infracloud went quick | 00:43 |
| *** zhurong has joined #openstack-infra | 00:49 | |
| *** eharney has quit IRC | 00:49 | |
| *** LindaWang has joined #openstack-infra | 00:49 | |
| *** spzala has joined #openstack-infra | 00:50 | |
| *** mat128 has joined #openstack-infra | 00:50 | |
| *** liujiong has joined #openstack-infra | 00:52 | |
| openstackgerrit | Matthew Treinish proposed openstack/os-testr master: Switch to stestr under the covers https://review.openstack.org/488441 | 00:54 |
| *** cshastri has joined #openstack-infra | 00:55 | |
| *** jamesmcarthur has joined #openstack-infra | 01:00 | |
| clarkb | rax iad and ord are the only two regions left and they are going slowly | 01:02 |
| fungi | 100% of a cpu on iowait? | 01:04 |
| clarkb | ya pretty high according to top (don't think it breaks it down by cpu though) | 01:07 |
| *** sekelso has joined #openstack-infra | 01:09 | |
| *** dave-mccowan has joined #openstack-infra | 01:10 | |
| *** skelso has joined #openstack-infra | 01:12 | |
| clarkb | ord has overtaken iad though and it started about an hour and a half later | 01:12 |
| *** jamesmcarthur has quit IRC | 01:14 | |
| fungi | hit the '1' key in top | 01:14 |
| *** zzzeek has quit IRC | 01:14 | |
| *** sekelso has quit IRC | 01:14 | |
| clarkb | its like 80/20 cpu0/cpu1 for wa | 01:14 |
| *** zzzeek has joined #openstack-infra | 01:15 | |
| clarkb | good news is in citycloud la1 the htcacheclean finished already for the 0100UTC run | 01:15 |
| clarkb | so I think maybe this does help | 01:15 |
| fungi | right on! | 01:15 |
| *** jamesmcarthur has joined #openstack-infra | 01:15 | |
| *** dangers_away has quit IRC | 01:17 | |
| *** dangers_away has joined #openstack-infra | 01:17 | |
| *** baoli has joined #openstack-infra | 01:19 | |
| *** yamamoto has quit IRC | 01:20 | |
| *** rwsu has quit IRC | 01:21 | |
| *** gildub has joined #openstack-infra | 01:22 | |
| *** yamamoto has joined #openstack-infra | 01:26 | |
| *** yamamoto has quit IRC | 01:27 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] LVM support for dib-block-device https://review.openstack.org/472065 | 01:28 |
| ianw | yolanda: ^ some graphs. http://imgur.com/a/h1srW (multi) http://imgur.com/a/cKjQR (spanned) . i think i want to just convince myself on multi-vg's with a unit test | 01:28 |
| *** yamamoto has joined #openstack-infra | 01:28 | |
| *** yamamoto has quit IRC | 01:29 | |
| *** yamamoto has joined #openstack-infra | 01:29 | |
| *** jamesmcarthur has quit IRC | 01:29 | |
| *** jamesmcarthur has joined #openstack-infra | 01:31 | |
| *** jamesmcarthur has quit IRC | 01:33 | |
| *** jamesmcarthur has joined #openstack-infra | 01:34 | |
| *** sree has joined #openstack-infra | 01:35 | |
| *** dhill_ has quit IRC | 01:38 | |
| pabelanger | clarkb: fungi: Ya, maybe? I haven't see what jobs are using it | 01:39 |
| *** sree has quit IRC | 01:40 | |
| *** cuongnv has joined #openstack-infra | 01:43 | |
| *** Apoorva_ has joined #openstack-infra | 01:43 | |
| *** Apoorva has quit IRC | 01:46 | |
| *** Apoorva_ has quit IRC | 01:47 | |
| *** jamesmcarthur has quit IRC | 01:47 | |
| openstackgerrit | wes hayutin proposed openstack-infra/project-config master: WIP: add oooq based undercloud-containers https://review.openstack.org/493715 | 01:47 |
| *** tonytan4ever has joined #openstack-infra | 01:48 | |
| pabelanger | ianw: 493681 if you are interested, adds bundle reverse proxy cache setting | 01:51 |
| *** tonytan4ever has quit IRC | 01:52 | |
| ianw | pabelanger: those __ supposed to be there? | 01:55 |
| pabelanger | ianw: ya, they rewrite . to _ | 01:56 |
| pabelanger | and use _ for space | 01:56 |
| *** baoli has quit IRC | 01:57 | |
| *** thorst has quit IRC | 01:59 | |
| ianw | oh, of course! | 01:59 |
| ianw | and a is b, then b is c, but d was taken, so c is e :) | 02:00 |
| *** yamahata has quit IRC | 02:00 | |
| *** sflanigan has quit IRC | 02:03 | |
| openstackgerrit | Merged openstack-infra/project-config master: tripleo: make undercloud-container non-voting https://review.openstack.org/493669 | 02:06 |
| *** eharney has joined #openstack-infra | 02:07 | |
| *** eharney has quit IRC | 02:08 | |
| openstackgerrit | Merged openstack-infra/project-config master: Update NODEPOOL_RUGYGEMS_PROXY / add bundle client support https://review.openstack.org/493681 | 02:08 |
| *** chlong_ has quit IRC | 02:12 | |
| *** hongbin has joined #openstack-infra | 02:12 | |
| *** dingyichen has joined #openstack-infra | 02:14 | |
| *** ianychoi_test2 has joined #openstack-infra | 02:14 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: Set the AFS mirrors in the upstream env config for oooq https://review.openstack.org/493726 | 02:14 |
| *** sflanigan has joined #openstack-infra | 02:16 | |
| *** sflanigan has joined #openstack-infra | 02:16 | |
| *** hongbin has quit IRC | 02:18 | |
| clarkb | ord cache cleanout is done, iad is last one running | 02:20 |
| *** hongbin has joined #openstack-infra | 02:20 | |
| *** yamamoto has quit IRC | 02:22 | |
| *** annegentle has quit IRC | 02:23 | |
| *** armax has quit IRC | 02:24 | |
| *** Julien-zte has quit IRC | 02:30 | |
| *** jamesmcarthur has joined #openstack-infra | 02:30 | |
| *** Julien-zte has joined #openstack-infra | 02:31 | |
| *** sree has joined #openstack-infra | 02:35 | |
| *** jamesmcarthur has quit IRC | 02:36 | |
| *** jamesmcarthur has joined #openstack-infra | 02:37 | |
| *** EricGonczer_ has joined #openstack-infra | 02:39 | |
| *** jamesmcarthur has quit IRC | 02:40 | |
| *** sree has quit IRC | 02:45 | |
| *** sree has joined #openstack-infra | 02:45 | |
| *** jamesmcarthur has joined #openstack-infra | 02:47 | |
| *** jianghuaw has joined #openstack-infra | 02:49 | |
| *** sree has quit IRC | 02:49 | |
| *** jamesmcarthur has quit IRC | 02:50 | |
| *** jamesmcarthur has joined #openstack-infra | 02:52 | |
| *** xarses_ has joined #openstack-infra | 02:53 | |
| *** gus has joined #openstack-infra | 02:54 | |
| *** jamesmcarthur has quit IRC | 02:55 | |
| *** xarses has quit IRC | 02:56 | |
| *** hongbin has quit IRC | 02:58 | |
| *** hongbin has joined #openstack-infra | 03:00 | |
| *** Guest80741 has quit IRC | 03:00 | |
| clarkb | it took less than 5 minutes for htcacheclean to run on sto2 mirror | 03:04 |
| clarkb | hopefully this holds up as the mirrors refill their caches | 03:04 |
| *** jcoufal has quit IRC | 03:05 | |
| *** jamesmcarthur has joined #openstack-infra | 03:06 | |
| *** jamesmcarthur has quit IRC | 03:09 | |
| *** jamesmcarthur has joined #openstack-infra | 03:13 | |
| *** jamesmcarthur has quit IRC | 03:15 | |
| *** Hal has joined #openstack-infra | 03:15 | |
| *** dave-mccowan has quit IRC | 03:15 | |
| *** Hal is now known as Guest35639 | 03:15 | |
| *** ramishra has joined #openstack-infra | 03:15 | |
| *** jamesmcarthur has joined #openstack-infra | 03:16 | |
| *** jamesmcarthur has quit IRC | 03:19 | |
| *** EricGonczer_ has quit IRC | 03:19 | |
| *** EricGonczer_ has joined #openstack-infra | 03:20 | |
| *** spzala has quit IRC | 03:20 | |
| *** yamamoto has joined #openstack-infra | 03:22 | |
| *** ramishra has quit IRC | 03:23 | |
| *** EricGonczer_ has quit IRC | 03:23 | |
| *** yamamoto has quit IRC | 03:29 | |
| *** yamamoto_ has joined #openstack-infra | 03:29 | |
| *** yamamoto_ has quit IRC | 03:31 | |
| *** links has joined #openstack-infra | 03:34 | |
| *** sflanigan has quit IRC | 03:34 | |
| *** psachin has joined #openstack-infra | 03:37 | |
| *** yamamoto has joined #openstack-infra | 03:39 | |
| *** skelso has quit IRC | 03:40 | |
| *** jamesmcarthur has joined #openstack-infra | 03:45 | |
| *** hongbin has quit IRC | 03:45 | |
| *** yamamoto has quit IRC | 03:47 | |
| *** jamesmcarthur has quit IRC | 03:49 | |
| *** sflanigan has joined #openstack-infra | 03:51 | |
| *** sflanigan has joined #openstack-infra | 03:51 | |
| *** isaacb has joined #openstack-infra | 03:51 | |
| *** markvoelker has quit IRC | 03:56 | |
| *** d0ugal has quit IRC | 04:06 | |
| *** mnencia has quit IRC | 04:06 | |
| *** uberjay has quit IRC | 04:06 | |
| *** Gorian has quit IRC | 04:07 | |
| *** jamielennox has quit IRC | 04:07 | |
| *** lamt has quit IRC | 04:07 | |
| *** andymccr has quit IRC | 04:07 | |
| *** mat128 has quit IRC | 04:08 | |
| *** esberglu has quit IRC | 04:10 | |
| *** mnencia has joined #openstack-infra | 04:11 | |
| *** yamamoto has joined #openstack-infra | 04:11 | |
| *** lamt has joined #openstack-infra | 04:11 | |
| *** Gorian has joined #openstack-infra | 04:11 | |
| *** andymccr has joined #openstack-infra | 04:12 | |
| *** uberjay has joined #openstack-infra | 04:12 | |
| openstackgerrit | Cao Xuan Hoang proposed openstack-infra/project-config master: Add neutron-vpnaas docs pub job to zuul layout https://review.openstack.org/446835 | 04:15 |
| *** jamielennox has joined #openstack-infra | 04:17 | |
| *** rcernin has joined #openstack-infra | 04:19 | |
| *** d0ugal has joined #openstack-infra | 04:19 | |
| *** yamamoto has quit IRC | 04:20 | |
| *** jamesmcarthur has joined #openstack-infra | 04:25 | |
| *** jamesmcarthur has quit IRC | 04:30 | |
| *** sflanigan has quit IRC | 04:40 | |
| *** jamesmcarthur has joined #openstack-infra | 04:46 | |
| *** jamesmcarthur has quit IRC | 04:50 | |
| *** nicolasbock has joined #openstack-infra | 04:52 | |
| *** rcernin has quit IRC | 04:52 | |
| *** sflanigan has joined #openstack-infra | 04:53 | |
| *** sflanigan has joined #openstack-infra | 04:53 | |
| *** esberglu has joined #openstack-infra | 04:54 | |
| *** DFFlanders has joined #openstack-infra | 04:58 | |
| *** esberglu has quit IRC | 04:59 | |
| *** nicolasbock has quit IRC | 04:59 | |
| *** nicolasbock has joined #openstack-infra | 05:04 | |
| *** yamamoto has joined #openstack-infra | 05:18 | |
| *** yamamoto has quit IRC | 05:23 | |
| *** jamesmcarthur has joined #openstack-infra | 05:27 | |
| *** jamesmcarthur has quit IRC | 05:32 | |
| *** isaacb has quit IRC | 05:37 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] LVM support for dib-block-device https://review.openstack.org/472065 | 05:48 |
| *** zz_ja has quit IRC | 05:56 | |
| *** zz_ja has joined #openstack-infra | 05:56 | |
| *** markvoelker has joined #openstack-infra | 05:57 | |
| *** leifmadsen has quit IRC | 05:57 | |
| *** leifmadsen has joined #openstack-infra | 05:58 | |
| *** ramishra has joined #openstack-infra | 06:00 | |
| *** jamesmcarthur has joined #openstack-infra | 06:08 | |
| *** quite has quit IRC | 06:09 | |
| *** quite has joined #openstack-infra | 06:09 | |
| *** ramishra has quit IRC | 06:11 | |
| *** jamesmcarthur has quit IRC | 06:13 | |
| *** jtomasek has joined #openstack-infra | 06:14 | |
| *** ramishra has joined #openstack-infra | 06:14 | |
| *** aeng has quit IRC | 06:14 | |
| *** quite has quit IRC | 06:15 | |
| *** quite has joined #openstack-infra | 06:16 | |
| *** spzala has joined #openstack-infra | 06:20 | |
| *** spzala has quit IRC | 06:24 | |
| *** markvoelker has quit IRC | 06:30 | |
| *** mwarad has joined #openstack-infra | 06:34 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Re-enable test_delayed_repo_init https://review.openstack.org/493659 | 06:38 |
| *** fabo has quit IRC | 06:39 | |
| *** fabo has joined #openstack-infra | 06:39 | |
| *** alexchadin has joined #openstack-infra | 06:39 | |
| *** jamesmcarthur has joined #openstack-infra | 06:40 | |
| *** tnovacik has joined #openstack-infra | 06:44 | |
| openstackgerrit | Ian Y. Choi proposed openstack-infra/project-config master: Disable Newton translations https://review.openstack.org/493757 | 06:44 |
| *** jamesmcarthur has quit IRC | 06:45 | |
| openstackgerrit | Ifat Afek proposed openstack-infra/project-config master: Add Vitrage python 35 jobs as non-voting https://review.openstack.org/493758 | 06:46 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/project-config master: OpenStack-Ansible .txt files should not be skipped https://review.openstack.org/493759 | 06:49 |
| *** e0ne has joined #openstack-infra | 06:51 | |
| *** claudiub has joined #openstack-infra | 06:53 | |
| *** rcernin has joined #openstack-infra | 07:01 | |
| *** thorst has joined #openstack-infra | 07:03 | |
| *** pcaruana has joined #openstack-infra | 07:06 | |
| *** thorst has quit IRC | 07:07 | |
| *** markus_z has joined #openstack-infra | 07:08 | |
| *** gus has quit IRC | 07:09 | |
| *** gus has joined #openstack-infra | 07:09 | |
| *** gildub has quit IRC | 07:10 | |
| *** e0ne has quit IRC | 07:11 | |
| *** yamamoto has joined #openstack-infra | 07:11 | |
| *** shardy has joined #openstack-infra | 07:13 | |
| *** eranrom has joined #openstack-infra | 07:16 | |
| *** jamesmcarthur has joined #openstack-infra | 07:16 | |
| *** eranrom has quit IRC | 07:16 | |
| *** yamamoto has quit IRC | 07:17 | |
| *** florianf has joined #openstack-infra | 07:17 | |
| *** aviau has quit IRC | 07:19 | |
| *** aviau has joined #openstack-infra | 07:19 | |
| *** jamesmcarthur has quit IRC | 07:21 | |
| *** aarefiev_afk is now known as aarefiev | 07:22 | |
| *** yamamoto has joined #openstack-infra | 07:23 | |
| *** jamesden_ has quit IRC | 07:23 | |
| *** shardy has quit IRC | 07:25 | |
| *** yamamoto has quit IRC | 07:26 | |
| *** isaacb has joined #openstack-infra | 07:26 | |
| *** tesseract has joined #openstack-infra | 07:27 | |
| *** camunoz has joined #openstack-infra | 07:27 | |
| *** gus has quit IRC | 07:28 | |
| *** markvoelker has joined #openstack-infra | 07:28 | |
| *** eranrom has joined #openstack-infra | 07:28 | |
| *** jamesdenton has joined #openstack-infra | 07:30 | |
| openstackgerrit | Ifat Afek proposed openstack-infra/project-config master: Add Vitrage python 35 jobs as non-voting https://review.openstack.org/493758 | 07:31 |
| *** tnovacik has quit IRC | 07:34 | |
| *** jpich has joined #openstack-infra | 07:35 | |
| *** binbincong has joined #openstack-infra | 07:37 | |
| *** isaacb has quit IRC | 07:39 | |
| *** egonzalez has joined #openstack-infra | 07:40 | |
| *** gildub has joined #openstack-infra | 07:45 | |
| *** martinkopec has joined #openstack-infra | 07:47 | |
| *** andreww has joined #openstack-infra | 07:50 | |
| *** isaacb has joined #openstack-infra | 07:51 | |
| *** jamesmcarthur has joined #openstack-infra | 07:52 | |
| *** adreznec has quit IRC | 07:52 | |
| *** xarses_ has quit IRC | 07:53 | |
| openstackgerrit | Ifat Afek proposed openstack-infra/project-config master: Add Vitrage python 35 jobs as non-voting https://review.openstack.org/493758 | 07:54 |
| *** eranrom has quit IRC | 07:56 | |
| *** jamesmcarthur has quit IRC | 07:56 | |
| *** adreznec has joined #openstack-infra | 07:58 | |
| *** eranrom has joined #openstack-infra | 07:59 | |
| *** markvoelker has quit IRC | 08:00 | |
| *** shardy has joined #openstack-infra | 08:13 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add node list to get_edges() https://review.openstack.org/493781 | 08:13 |
| *** isaacb has quit IRC | 08:13 | |
| *** tdasilva has quit IRC | 08:18 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/devstack-gate master: Update grenade settings for stable/pike https://review.openstack.org/493057 | 08:20 |
| *** ccamacho has joined #openstack-infra | 08:20 | |
| *** ramishra has quit IRC | 08:22 | |
| *** isaacb has joined #openstack-infra | 08:22 | |
| *** priteau has joined #openstack-infra | 08:23 | |
| openstackgerrit | Ifat Afek proposed openstack-infra/project-config master: Add Vitrage python 35 jobs as non-voting https://review.openstack.org/493758 | 08:23 |
| *** lucas-afk is now known as lucasagomes | 08:26 | |
| *** jamesmcarthur has joined #openstack-infra | 08:28 | |
| *** electrofelix has joined #openstack-infra | 08:28 | |
| *** eranrom_ has joined #openstack-infra | 08:30 | |
| *** alexchadin has quit IRC | 08:31 | |
| *** eranrom has quit IRC | 08:31 | |
| openstackgerrit | Numan Siddique proposed openstack-infra/project-config master: Add TripleO scenario007-container for OVN https://review.openstack.org/490622 | 08:32 |
| *** jamesmcarthur has quit IRC | 08:33 | |
| *** esberglu has joined #openstack-infra | 08:33 | |
| *** alexchadin has joined #openstack-infra | 08:36 | |
| *** esberglu has quit IRC | 08:37 | |
| *** efoley has joined #openstack-infra | 08:39 | |
| *** dingyichen has quit IRC | 08:48 | |
| odyssey4me | Seeing an awful lot of yum mirror failures like http://logs.openstack.org/23/493623/2/check/gate-openstack-ansible-lxc_container_create-ansible-func-centos-7/8dd09ae/console.html#_2017-08-15_07_46_45_819203 this morning - any idea what's going on? | 08:49 |
| *** tuanluong has joined #openstack-infra | 08:50 | |
| *** eranrom_ has quit IRC | 08:53 | |
| *** ianychoi_test2 has quit IRC | 08:54 | |
| *** lifeless_ is now known as lifeless | 08:56 | |
| *** markvoelker has joined #openstack-infra | 08:57 | |
| *** tosky has joined #openstack-infra | 09:00 | |
| *** gcb has joined #openstack-infra | 09:02 | |
| *** jamesmcarthur has joined #openstack-infra | 09:04 | |
| *** thorst has joined #openstack-infra | 09:04 | |
| *** thorst has quit IRC | 09:08 | |
| *** jamesmcarthur has quit IRC | 09:08 | |
| *** mwarad has quit IRC | 09:12 | |
| *** shardy has quit IRC | 09:24 | |
| *** shardy has joined #openstack-infra | 09:26 | |
| *** markvoelker has quit IRC | 09:31 | |
| *** alexchadin has quit IRC | 09:34 | |
| *** e0ne has joined #openstack-infra | 09:34 | |
| *** alexchadin has joined #openstack-infra | 09:38 | |
| *** jamesmcarthur has joined #openstack-infra | 09:40 | |
| *** jamesmcarthur has quit IRC | 09:44 | |
| *** cshastri has quit IRC | 09:45 | |
| *** eroux has joined #openstack-infra | 09:48 | |
| *** shardy has quit IRC | 09:54 | |
| *** shardy has joined #openstack-infra | 09:54 | |
| *** cuongnv has quit IRC | 09:55 | |
| *** eroux has quit IRC | 09:56 | |
| *** thorst has joined #openstack-infra | 10:05 | |
| *** ramishra has joined #openstack-infra | 10:06 | |
| *** thorst has quit IRC | 10:09 | |
| *** dtantsur|afk is now known as dtantsur | 10:15 | |
| *** jamesmcarthur has joined #openstack-infra | 10:16 | |
| *** psachin_ has joined #openstack-infra | 10:18 | |
| *** psachin has quit IRC | 10:18 | |
| *** jamesmcarthur has quit IRC | 10:20 | |
| *** spzala has joined #openstack-infra | 10:21 | |
| *** esberglu has joined #openstack-infra | 10:21 | |
| *** spzala has quit IRC | 10:26 | |
| *** esberglu has quit IRC | 10:26 | |
| *** psachin_ has quit IRC | 10:26 | |
| *** markvoelker has joined #openstack-infra | 10:28 | |
| *** mpranjic has quit IRC | 10:31 | |
| *** jkilpatr has quit IRC | 10:34 | |
| *** psachin_ has joined #openstack-infra | 10:40 | |
| *** hyakuhei has joined #openstack-infra | 10:43 | |
| *** hyakuhei has quit IRC | 10:43 | |
| *** hyakuhei has joined #openstack-infra | 10:43 | |
| *** hyakuhei has quit IRC | 10:43 | |
| *** hyakuhei has joined #openstack-infra | 10:43 | |
| *** alexchadin has quit IRC | 10:49 | |
| fungi | odyssey4me: usually when this happens (which is disappointingly often) it's because the indices on official fedora mirrors are broken and so we're mirroring their already broken state. they tend to correct it but it can often take hours | 10:51 |
| *** jamesmcarthur has joined #openstack-infra | 10:52 | |
| *** sambetts|afk is now known as sambetts | 10:52 | |
| *** jkilpatr has joined #openstack-infra | 10:52 | |
| *** gildub has quit IRC | 10:53 | |
| fungi | infra-root: reminder... i'm not going to be around much today (stuck in a car most of the day since i have to go to the mainland for an appointment), but hope to be online some again around/after 21:00 utc | 10:54 |
| *** alexchadin has joined #openstack-infra | 10:55 | |
| *** niska has quit IRC | 10:56 | |
| *** jamesmcarthur has quit IRC | 10:56 | |
| *** markvoelker has quit IRC | 11:00 | |
| odyssey4me | fungi hmm, it would be rather nice if we could automate some sort of test around that and revert to a previous state or something... unfortunately that's not something I am able to commit to doing so we'll just have to live with it :/ | 11:03 |
| fungi | odyssey4me: that was one of the goals with using afs-backed mirrors is that we should be able to check the updated index state against the packages in the filesystem and refrain from releasing that changed state until everything matches again | 11:04 |
| fungi | just need someone with the time to write that archive consistency checker | 11:05 |
| *** alexchadin has quit IRC | 11:06 | |
| openstackgerrit | Merged openstack-infra/project-config master: Set template-hostname for vexxhost https://review.openstack.org/493633 | 11:08 |
| *** zhurong has quit IRC | 11:08 | |
| *** zhurong has joined #openstack-infra | 11:12 | |
| *** Julien-zte has quit IRC | 11:25 | |
| *** thorst has joined #openstack-infra | 11:25 | |
| *** niska has joined #openstack-infra | 11:26 | |
| *** Julien-zte has joined #openstack-infra | 11:26 | |
| *** binbincong has quit IRC | 11:26 | |
| *** jamesmcarthur has joined #openstack-infra | 11:28 | |
| *** thorst has quit IRC | 11:29 | |
| *** tosky has quit IRC | 11:30 | |
| *** binbincong has joined #openstack-infra | 11:34 | |
| *** ldnunes has joined #openstack-infra | 11:35 | |
| *** jamesmcarthur has quit IRC | 11:36 | |
| *** liujiong has quit IRC | 11:36 | |
| *** tosky has joined #openstack-infra | 11:41 | |
| *** lucasagomes is now known as lucas-hungry | 11:41 | |
| *** sree has joined #openstack-infra | 11:46 | |
| *** sree has quit IRC | 11:50 | |
| *** kambiz has quit IRC | 11:51 | |
| *** clarkb has quit IRC | 11:52 | |
| *** dave-mccowan has joined #openstack-infra | 11:53 | |
| *** kambiz has joined #openstack-infra | 11:54 | |
| *** gus has joined #openstack-infra | 11:55 | |
| *** markvoelker has joined #openstack-infra | 11:57 | |
| *** dprince has joined #openstack-infra | 12:00 | |
| *** thorst has joined #openstack-infra | 12:03 | |
| *** Guest35639 has quit IRC | 12:05 | |
| *** tuanluong has quit IRC | 12:07 | |
| *** esberglu has joined #openstack-infra | 12:09 | |
| *** esberglu has quit IRC | 12:14 | |
| *** mpranjic has joined #openstack-infra | 12:14 | |
| mpranjic | hi | 12:15 |
| mpranjic | anyone that can help investigate one account that fails to login to wiki.openstack.org? | 12:15 |
| *** rhallisey has joined #openstack-infra | 12:18 | |
| *** jamesden_ has joined #openstack-infra | 12:18 | |
| *** clarkb has joined #openstack-infra | 12:19 | |
| *** Hal has joined #openstack-infra | 12:20 | |
| *** Hal is now known as Guest73584 | 12:21 | |
| *** gouthamr has quit IRC | 12:21 | |
| *** markvoelker has quit IRC | 12:21 | |
| *** sshnaidm|off is now known as sshnaidm | 12:21 | |
| *** rlandy has joined #openstack-infra | 12:21 | |
| *** markvoelker has joined #openstack-infra | 12:21 | |
| *** mat128 has joined #openstack-infra | 12:25 | |
| *** lucas-hungry is now known as lucasagomes | 12:26 | |
| *** zhurong has quit IRC | 12:27 | |
| *** gcb has quit IRC | 12:30 | |
| mhayden | pabelanger: looks like devstack might be installing the rdo repo in stack.sh https://review.openstack.org/493003 | 12:30 |
| *** ykarel has joined #openstack-infra | 12:32 | |
| *** ykarel_ has joined #openstack-infra | 12:33 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: test pike job https://review.openstack.org/493857 | 12:34 |
| *** ykarel has quit IRC | 12:36 | |
| *** EricGonczer_ has joined #openstack-infra | 12:39 | |
| *** gildub has joined #openstack-infra | 12:42 | |
| *** gouthamr has joined #openstack-infra | 12:49 | |
| *** LindaWang has quit IRC | 12:50 | |
| *** makowals has quit IRC | 12:52 | |
| *** russellb has quit IRC | 12:52 | |
| *** russellb has joined #openstack-infra | 12:52 | |
| *** makowals has joined #openstack-infra | 12:53 | |
| *** esberglu has joined #openstack-infra | 12:54 | |
| *** makowals has quit IRC | 12:55 | |
| *** gildub has quit IRC | 12:55 | |
| *** makowals has joined #openstack-infra | 12:57 | |
| *** bh526r has joined #openstack-infra | 13:00 | |
| *** jcoufal has joined #openstack-infra | 13:00 | |
| *** skelso has joined #openstack-infra | 13:04 | |
| *** askb has quit IRC | 13:07 | |
| *** ihrachys has joined #openstack-infra | 13:10 | |
| *** makowals has quit IRC | 13:10 | |
| *** spzala has joined #openstack-infra | 13:13 | |
| asettle | fungi: you around? :) | 13:14 |
| *** makowals has joined #openstack-infra | 13:17 | |
| *** persia has joined #openstack-infra | 13:17 | |
| *** yongwc has joined #openstack-infra | 13:20 | |
| *** eharney has joined #openstack-infra | 13:21 | |
| *** baoli has joined #openstack-infra | 13:24 | |
| strigazi | cores can we take https://review.openstack.org/#/c/493556/ in? | 13:25 |
| strigazi | fungi: ^^ | 13:28 |
| strigazi | pabelanger ^^ | 13:28 |
| AJaeger | asettle, strigazi, he's out most of the day - see his message from 10:54 UTC | 13:28 |
| *** makowals has quit IRC | 13:28 | |
| asettle | thanky thanky :) | 13:29 |
| *** makowals has joined #openstack-infra | 13:29 | |
| *** baoli has quit IRC | 13:29 | |
| *** Guest52189 is now known as rook | 13:29 | |
| strigazi | AJaeger thanks | 13:29 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Add some examples to user guide Concepts section https://review.openstack.org/493873 | 13:30 |
| *** alexchadin has joined #openstack-infra | 13:32 | |
| *** psachin_ has quit IRC | 13:32 | |
| *** chlong_ has joined #openstack-infra | 13:38 | |
| seanhandley_ | AJaeger: Can you add me to the publiccloud-wg-core/publiccloud-wg-release groups on gerrit please? | 13:39 |
| *** seanhandley_ is now known as seanhandley | 13:39 | |
| seanhandley | or anyone else on the infra team who's free ? | 13:39 |
| AJaeger | seanhandley: I don't have those permissions, hope others have time... | 13:40 |
| seanhandley | AJaeger: Ok. Anybody in particular I should try to talk to about it? | 13:41 |
| *** LindaWang has joined #openstack-infra | 13:41 | |
| mhayden | fungi: remember the odd issue the other day where some nodes had older versions of project-config? it appears to be back starting yesterday afternoon | 13:45 |
| AJaeger | seanhandley: I hope an infra-root shows up in the next two hours and can help you. Otherwise, send an email to openstack-infra mailing list and reference the change that addeded the groups. | 13:45 |
| AJaeger | mhayden: do you have log files? | 13:45 |
| mhayden | AJaeger: yessir -- please hold | 13:45 |
| *** baoli has joined #openstack-infra | 13:46 | |
| mhayden | AJaeger: http://logs.openstack.org/76/493876/1/check/gate-ansible-hardening-ansible-func-centos-7/b042d1e/console.html | 13:46 |
| Shrews | AJaeger: seanhandley: what the change #? | 13:46 |
| mhayden | or well hold on | 13:46 |
| mhayden | that one isn't it | 13:46 |
| mhayden | AJaeger: i'll try to find one of the other reviews | 13:46 |
| AJaeger | mhayden: plesae do - and explain exactly why you think it's an old copy. | 13:47 |
| *** ykarel_ has quit IRC | 13:47 | |
| AJaeger | Shrews: https://review.openstack.org/489548 AFAIK | 13:48 |
| *** psachin_ has joined #openstack-infra | 13:48 | |
| seanhandley | Thanks AJaeger / Shrews | 13:49 |
| seanhandley | that's the one | 13:49 |
| Shrews | seanhandley: AJaeger: done | 13:49 |
| seanhandley | Awesome - thanks again :-) | 13:50 |
| *** makowals has quit IRC | 13:51 | |
| *** psachin_ has quit IRC | 13:53 | |
| *** hongbin has joined #openstack-infra | 13:53 | |
| *** ramishra has quit IRC | 13:55 | |
| *** makowals has joined #openstack-infra | 13:56 | |
| *** skelso has quit IRC | 13:58 | |
| *** skelso has joined #openstack-infra | 13:59 | |
| *** ramishra has joined #openstack-infra | 13:59 | |
| *** ramishra has quit IRC | 14:04 | |
| *** ramishra has joined #openstack-infra | 14:06 | |
| *** links has quit IRC | 14:06 | |
| *** strigazi is now known as strigazi_off | 14:07 | |
| *** rbrndt has joined #openstack-infra | 14:07 | |
| *** strigazi_off is now known as strigazi_OFF | 14:08 | |
| *** amotoki__away is now known as amotoki | 14:12 | |
| *** marst has joined #openstack-infra | 14:14 | |
| *** eranrom has joined #openstack-infra | 14:16 | |
| *** ykarel_ has joined #openstack-infra | 14:19 | |
| *** eharney has quit IRC | 14:20 | |
| *** eharney has joined #openstack-infra | 14:20 | |
| *** eharney has quit IRC | 14:20 | |
| *** yongwc has quit IRC | 14:21 | |
| *** eharney has joined #openstack-infra | 14:21 | |
| openstackgerrit | Ed Leafe proposed openstack-infra/irc-meetings master: Change name of API-WG to API-SIG https://review.openstack.org/493896 | 14:24 |
| *** signed8bit has joined #openstack-infra | 14:29 | |
| *** felipemonteiro has joined #openstack-infra | 14:33 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:34 | |
| *** ykarel_ has quit IRC | 14:35 | |
| *** EricGonc_ has joined #openstack-infra | 14:36 | |
| *** EricGonczer_ has quit IRC | 14:37 | |
| *** efried_zzz is now known as efried | 14:37 | |
| *** felipemonteiro has quit IRC | 14:38 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config master: Temporarily stop using citycloud-la1 https://review.openstack.org/493899 | 14:38 |
| fungi | infra-root: daniel at citynet asked us to stop using la1 for now ^ | 14:39 |
| fungi | project-config-core: ^ | 14:39 |
| pabelanger | +2 | 14:39 |
| smcginnis | Glad we're past the milestone crunch. | 14:40 |
| *** AJaeger has quit IRC | 14:40 | |
| mnaser | fungi we can probably bump it a bit more on our side if queue struggles | 14:43 |
| mnaser | so feel free to ping if that's the case | 14:43 |
| fungi | mnaser: thanks! hoping we get ovh back up next week once our contacts there get back from vacation and reauthorize our accounts | 14:43 |
| mnaser | cool! | 14:44 |
| fungi | i'm not around today (just happened to catch a moment to sit somewhere and hook up the wireless modem so i could check in) but other infra-root folk likely have an eye or several on things | 14:44 |
| pabelanger | fungi: clarkb: still seeing a large amount of networking issues in sto2: http://status.openstack.org/elastic-recheck/#1708704 | 14:45 |
| pabelanger | I am going to look at mirror shortly and confirm settings | 14:45 |
| pabelanger | possible we need to bump it up to 4C/8GB also | 14:45 |
| fungi | pabelanger: thanks for checking it | 14:45 |
| *** sree has joined #openstack-infra | 14:46 | |
| clarkb | infra-root have you seen console logs cut off like this before ? http://logs.openstack.org/64/492964/8/check/gate-nova-tox-functional-py35-ubuntu-xenial/e6188ff/console.html my initial guess is maybe we ran out of disk where we were writing it? | 14:48 |
| pabelanger | clarkb: job timeout: http://logs.openstack.org/64/492964/8/check/gate-nova-tox-functional-py35-ubuntu-xenial/e6188ff/console.html#_2017-08-15_13_54_46_923759 | 14:50 |
| *** sree has quit IRC | 14:50 | |
| *** signed8bit has quit IRC | 14:50 | |
| clarkb | pabelanger: oh interesting and we kept writing output to the log while things got cleaned up. Thanks | 14:51 |
| *** signed8bit has joined #openstack-infra | 14:51 | |
| clarkb | pabelanger: mnaser looks like that ran in vexxhost, is that a failure you'll want to look at more closely? | 14:53 |
| *** signed8bit has quit IRC | 14:53 | |
| *** signed8bit has joined #openstack-infra | 14:55 | |
| mnaser | clarkb that flavor has 200GB .. i doubt it would run out of space | 14:56 |
| mnaser | or could it? | 14:56 |
| clarkb | mnaser: maybe /tmp is a tmpfs? | 14:56 |
| clarkb | (though I don't think it is on our images) | 14:56 |
| clarkb | I have a call in a couple minutes but can help dig in after | 14:56 |
| mnaser | clarkb http://logs.openstack.org/64/492964/8/check/gate-nova-tox-functional-py35-ubuntu-xenial/e6188ff/ i wonder what that tmpt27cv_h6 file is | 14:56 |
| * mnaser is in midst of puppet 3 or 4 upgrade | 14:56 | |
| clarkb | mnaser: I think that is the subunit file when the tox run doesn't finish | 14:57 |
| mnaser | s/or/to/ | 14:57 |
| mnaser | ill eye on it in a bit | 14:57 |
| clarkb | mnaser: the way subunit works is it writes a tmp file and then when complete mv's it so we gather either the finished complete file or the tmp file if it exists in an effort to collect as much data as possible | 14:57 |
| dansmith | mnaser: it was a timeout, remember not actually a disk full right? | 14:57 |
| mnaser | dansmith yeah, noisy neighbour is always a possiblity but we want to minimize that | 14:58 |
| mnaser | i've been trying to keep an eye on logstash for failures | 14:58 |
| *** jamesmcarthur has joined #openstack-infra | 14:58 | |
| *** sekelso has joined #openstack-infra | 15:00 | |
| mnaser | ill have a more in depth look once done with this upgrade | 15:00 |
| *** skelso has quit IRC | 15:00 | |
| *** LindaWang has quit IRC | 15:01 | |
| *** mattmceuen has joined #openstack-infra | 15:01 | |
| *** rcernin has quit IRC | 15:01 | |
| clarkb | I've approved la1 removal (also see their email) | 15:03 |
| *** baoli has quit IRC | 15:03 | |
| *** sekelso has quit IRC | 15:03 | |
| *** baoli has joined #openstack-infra | 15:03 | |
| *** markus_z has quit IRC | 15:04 | |
| *** armax has joined #openstack-infra | 15:05 | |
| *** AJaeger has joined #openstack-infra | 15:07 | |
| *** signed8bit has quit IRC | 15:09 | |
| *** signed8bit has joined #openstack-infra | 15:09 | |
| *** jrich has quit IRC | 15:10 | |
| *** makowals has quit IRC | 15:10 | |
| *** makowals has joined #openstack-infra | 15:11 | |
| *** florianf has quit IRC | 15:12 | |
| *** AJaeger has quit IRC | 15:16 | |
| *** AJaeger has joined #openstack-infra | 15:16 | |
| *** AJaeger has quit IRC | 15:17 | |
| *** AJaeger has joined #openstack-infra | 15:17 | |
| *** hrybacki is now known as hrybacki|mtg | 15:17 | |
| *** Guest11213 is now known as kmalloc | 15:19 | |
| *** kmalloc has joined #openstack-infra | 15:19 | |
| openstackgerrit | Merged openstack-infra/project-config master: Temporarily stop using citycloud-la1 https://review.openstack.org/493899 | 15:19 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create mock secret for validation https://review.openstack.org/493918 | 15:20 |
| *** Guest73584 has quit IRC | 15:20 | |
| *** baoli has quit IRC | 15:21 | |
| *** baoli has joined #openstack-infra | 15:21 | |
| *** baoli has quit IRC | 15:22 | |
| pabelanger | clarkb: fungi: mordred: jeblair: I am unsure if we still want to do this or not^, but adds a mock secret to base-test playbooks | 15:22 |
| *** florianf has joined #openstack-infra | 15:22 | |
| fungi | thanks clarkb! | 15:22 |
| fungi | i need to disappear again, but hopefully back around in another 5-ish hours | 15:22 |
| jeblair | pabelanger: why base-test? | 15:22 |
| pabelanger | jeblair: wasn't sure if we wanted it in base | 15:23 |
| jeblair | pabelanger: why base? | 15:23 |
| jeblair | pabelanger: like, i don't understand the strategy here | 15:23 |
| *** pcaruana has quit IRC | 15:24 | |
| jeblair | pabelanger: weren't you going to make a test version of the tarball job uploading to zuulv3-dev? | 15:25 |
| pabelanger | Same, I am not sure if we want to move forward with production SSH key or create dummy sercret and make sure the data isn't leaked in logs | 15:25 |
| jeblair | okay, let's try to figure out what we're doing | 15:26 |
| AJaeger | jeblair: please have a look at change 491109 with gerry and review the diff - I see the initial diff but then scroll down for ages. The comment at line 13xxx is a challenge | 15:26 |
| jeblair | afaik there are two things we could do to improve our stance | 15:26 |
| jeblair | 1) add unit tests for leaking secrets | 15:26 |
| jeblair | 2) make a job as close to the tarball upload job as possible, but without the actual ssh key | 15:26 |
| jeblair | let's do both of those things | 15:27 |
| jeblair | i believe the suggestion to create a "tarball" job that uploaded to zuulv3-dev would satisfy #2 | 15:27 |
| pabelanger | okay | 15:28 |
| jeblair | pabelanger: now, having said all that -- is there anything you wanted to accomplish in 493918 that won't be accomplished by those things? | 15:28 |
| pabelanger | jeblair: no, what you have listed should be fine for me. But we should confirm with others | 15:29 |
| jeblair | clarkb, fungi, mordred: ^ please confirm | 15:29 |
| clarkb | ya I think that plan is good | 15:29 |
| jeblair | now who is going to work on #1? | 15:29 |
| jeblair | i guess i will | 15:30 |
| *** camunoz has quit IRC | 15:30 | |
| jeblair | infra-root: would someone please take over the inap rename process? starts with change 493226. i no longer have time. | 15:31 |
| pabelanger | I can help with #1 | 15:31 |
| jeblair | pabelanger: i will welcome your help after you finish #2 | 15:31 |
| jeblair | let me start on it so we can parallelize some stuff | 15:32 |
| *** baoli has joined #openstack-infra | 15:32 | |
| pabelanger | okay | 15:32 |
| *** links has joined #openstack-infra | 15:32 | |
| pabelanger | jeblair: should I update 492671 to use zuulv3.o.o? or a new patch | 15:32 |
| jeblair | pabelanger: doesn't matter | 15:32 |
| pabelanger | ok | 15:33 |
| AJaeger | infra-root, do you know why change 492715 does not merge? Dependency is merged, it's approved - but Zuul v3 seems to ignore it. This is a job for openstack-zuul-jobs | 15:33 |
| jeblair | AJaeger: whas it approved after its dependency merged? | 15:34 |
| AJaeger | jeblair: dependency merged 4 days ok, was approved last night - and I reapproved as well - no reaction | 15:34 |
| AJaeger | Wait, it's marked as merged now. | 15:35 |
| AJaeger | Why does it show up in my list - let me check something ... | 15:35 |
| *** Hal has joined #openstack-infra | 15:35 | |
| AJaeger | ARgh, I was confused. The dependency is merged, 492715 is not | 15:35 |
| *** Hal is now known as Guest6713 | 15:35 | |
| *** isaacb has quit IRC | 15:35 | |
| AJaeger | so, ignore my three lines above, please | 15:36 |
| jeblair | right. problem exists as originally stated. :) | 15:37 |
| rybridges | Good morning guys! :) | 15:37 |
| rybridges | Do you think there is any chance we could please merge this today? https://review.openstack.org/#/c/492693/ | 15:38 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/project-config master: Disable py2 dsvm on nodepool feature/zuulv3 branch https://review.openstack.org/492629 | 15:39 |
| pabelanger | jeblair: are you okay with manually provisioning zuulv3-dev.o.o zuul user authorized_keys file? Server is still in emergency file | 15:41 |
| *** vhosakot has joined #openstack-infra | 15:41 | |
| jeblair | pabelanger: y | 15:41 |
| *** Julien-zte has quit IRC | 15:42 | |
| *** Julien-zte has joined #openstack-infra | 15:43 | |
| *** tesseract has quit IRC | 15:44 | |
| *** jamesmcarthur has quit IRC | 15:46 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Zuulv3: capitalize approvals https://review.openstack.org/493925 | 15:47 |
| jeblair | AJaeger, pabelanger, mordred: ^ i'm not certain, but that may be the cause of the not-gating error. | 15:47 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/project-config master: Disable py2 dsvm on nodepool feature/zuulv3 branch https://review.openstack.org/492629 | 15:48 |
| *** xyang1 has joined #openstack-infra | 15:48 | |
| *** hrybacki|mtg is now known as hrybacki | 15:49 | |
| AJaeger | jeblair: Zuul is dependent on proper capitalization? That will cause quite some fun with debugging ;( | 15:53 |
| *** signed8bit is now known as signed8bit_Zzz | 15:53 | |
| *** Julien-zte has quit IRC | 15:54 | |
| *** Julien-zte has joined #openstack-infra | 15:54 | |
| jeblair | AJaeger: gerrit is | 15:55 |
| AJaeger | jeblair: ;( | 15:56 |
| jeblair | AJaeger: in some database configurations, including one that we intend to migrate to (after we start using zuulv3) | 15:56 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create site_zuulv3_dev secret https://review.openstack.org/492671 | 15:56 |
| jeblair | AJaeger: it shouldn't affect very many places -- just those pipeline configuratoins | 15:56 |
| AJaeger | jeblair: I see, thank for tracking this down. | 15:56 |
| pabelanger | jeblair: AJaeger: +3 | 15:57 |
| AJaeger | jeblair: what do you think about adding a comment above them that capitalization is important? | 15:57 |
| jeblair | that would be fine | 15:57 |
| AJaeger | jeblair: sicne your change is approved, let me provide a change on top of it... | 15:58 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create site_zuulv3_dev secret https://review.openstack.org/492671 | 15:58 |
| pabelanger | jeblair: do you mind looking at 492671 when you have a moment to see if that lines up with your #2. That's the first step needed for trusted playbook | 15:59 |
| *** signed8bit_Zzz is now known as signed8bit | 15:59 | |
| pabelanger | jeblair: actually, I just noticed and issue. I moment | 16:00 |
| *** florianf has quit IRC | 16:01 | |
| openstackgerrit | Sean Handley proposed openstack-infra/project-config master: Add IRC notifications for #openstack-publiccloud. https://review.openstack.org/493934 | 16:01 |
| *** links has quit IRC | 16:01 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create site_zuulv3_dev secret https://review.openstack.org/492671 | 16:01 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add comment to zuul.yaml https://review.openstack.org/493936 | 16:02 |
| AJaeger | jeblair: ^ | 16:02 |
| AJaeger | bbl | 16:03 |
| mnaser | dansmith clarkb pabelanger identified the cause of the timeout. i've cleared it out and it shouldn't happen again | 16:04 |
| clarkb | mnaser: thank you! | 16:04 |
| *** yamahata has joined #openstack-infra | 16:05 | |
| clarkb | looks like htcacheclean on iad mirror takes less than an hour | 16:05 |
| *** jamesmcarthur has joined #openstack-infra | 16:06 | |
| clarkb | this is our slowest IO node in useright now I think so that looks good | 16:06 |
| *** krtaylor has quit IRC | 16:06 | |
| pabelanger | clarkb: that is good news | 16:06 |
| dansmith | mnaser: cool | 16:06 |
| *** e0ne has quit IRC | 16:07 | |
| openstackgerrit | Merged openstack-infra/project-config master: Zuulv3: capitalize approvals https://review.openstack.org/493925 | 16:07 |
| *** jpich has quit IRC | 16:09 | |
| *** lucasagomes is now known as lucas-afk | 16:10 | |
| *** jamesmcarthur has quit IRC | 16:10 | |
| *** egonzalez has quit IRC | 16:10 | |
| clarkb | that is with 25GB in cache too. So assuming things scale linearly (probably bad assumption) we are looking at under 2 hours for total cleanup | 16:11 |
| *** Apoorva has joined #openstack-infra | 16:11 | |
| *** srwilkers_ has quit IRC | 16:12 | |
| *** slaweq has joined #openstack-infra | 16:15 | |
| *** florianf has joined #openstack-infra | 16:16 | |
| *** pbourke has quit IRC | 16:17 | |
| *** jamesmcarthur has joined #openstack-infra | 16:19 | |
| *** pbourke has joined #openstack-infra | 16:21 | |
| *** alexchadin has quit IRC | 16:21 | |
| *** alexchadin has joined #openstack-infra | 16:22 | |
| *** alexchadin has quit IRC | 16:22 | |
| *** alexchadin has joined #openstack-infra | 16:23 | |
| *** alexchadin has quit IRC | 16:23 | |
| *** alexchadin has joined #openstack-infra | 16:24 | |
| *** alexchadin has quit IRC | 16:24 | |
| *** alexchadin has joined #openstack-infra | 16:24 | |
| *** alexchadin has quit IRC | 16:25 | |
| *** alexchadin has joined #openstack-infra | 16:25 | |
| *** alexchadin has quit IRC | 16:28 | |
| *** EricGonc_ has quit IRC | 16:29 | |
| *** tnovacik has joined #openstack-infra | 16:30 | |
| *** ihrachys has quit IRC | 16:33 | |
| *** ihrachys has joined #openstack-infra | 16:34 | |
| *** ihrachys has quit IRC | 16:35 | |
| *** jamesmcarthur has quit IRC | 16:35 | |
| *** rlandy is now known as rlandy|brb | 16:36 | |
| *** ihrachys has joined #openstack-infra | 16:37 | |
| *** rlandy|brb is now known as rlandy | 16:37 | |
| openstackgerrit | German Eichberger proposed openstack-infra/project-config master: Add gate jobs for new openstack-ansible Octavia scenario https://review.openstack.org/491109 | 16:39 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Change name of API-WG to API-SIG https://review.openstack.org/493896 | 16:39 |
| *** Guest6713 has quit IRC | 16:39 | |
| *** trown is now known as trown|lunch | 16:44 | |
| *** krtaylor has joined #openstack-infra | 16:46 | |
| openstackgerrit | Dima Kuznetsov proposed openstack-infra/project-config master: Add networking-sfc to Dragonflow's tempest job https://review.openstack.org/493950 | 16:47 |
| *** dtantsur is now known as dtantsur|afk | 16:49 | |
| *** esberglu is now known as esberglu_lunch | 16:50 | |
| *** ramishra has quit IRC | 16:51 | |
| *** ramishra has joined #openstack-infra | 16:54 | |
| *** slaweq has quit IRC | 16:56 | |
| *** baoli has quit IRC | 17:01 | |
| *** Hal has joined #openstack-infra | 17:02 | |
| *** baoli has joined #openstack-infra | 17:02 | |
| *** Hal is now known as Guest10721 | 17:02 | |
| *** baoli has quit IRC | 17:02 | |
| *** ihrachys has quit IRC | 17:05 | |
| *** felipemonteiro_ has quit IRC | 17:05 | |
| *** ihrachys has joined #openstack-infra | 17:06 | |
| *** jkilpatr has quit IRC | 17:08 | |
| *** ihrachys_ has joined #openstack-infra | 17:09 | |
| *** ihrachys has quit IRC | 17:11 | |
| *** Guest10721 has quit IRC | 17:12 | |
| *** baoli has joined #openstack-infra | 17:12 | |
| *** kzaitsev1pi has quit IRC | 17:13 | |
| *** kzaitsev_pi has joined #openstack-infra | 17:18 | |
| *** jcoufal has quit IRC | 17:20 | |
| *** jcoufal has joined #openstack-infra | 17:21 | |
| *** slaweq has joined #openstack-infra | 17:21 | |
| *** tosky has quit IRC | 17:23 | |
| *** rbrndt has quit IRC | 17:29 | |
| *** martinkopec has quit IRC | 17:30 | |
| *** sbezverk has joined #openstack-infra | 17:32 | |
| *** slaweq has quit IRC | 17:32 | |
| *** baoli has quit IRC | 17:32 | |
| *** baoli has joined #openstack-infra | 17:33 | |
| *** Hal has joined #openstack-infra | 17:34 | |
| *** Hal is now known as Guest76967 | 17:35 | |
| *** thorst has quit IRC | 17:35 | |
| *** thorst has joined #openstack-infra | 17:37 | |
| *** szaher has quit IRC | 17:38 | |
| *** thorst has quit IRC | 17:41 | |
| *** e0ne has joined #openstack-infra | 17:43 | |
| *** sambetts is now known as sambetts|afk | 17:43 | |
| *** claudiub has quit IRC | 17:44 | |
| *** trown|lunch is now known as trown | 17:44 | |
| *** jkilpatr has joined #openstack-infra | 17:44 | |
| *** florianf has quit IRC | 17:46 | |
| *** jamesmcarthur has joined #openstack-infra | 17:46 | |
| *** tosky has joined #openstack-infra | 17:47 | |
| *** efoley has quit IRC | 17:49 | |
| *** tnovacik has quit IRC | 17:49 | |
| *** srobert has joined #openstack-infra | 17:52 | |
| *** shardy is now known as shardy_afk | 17:53 | |
| *** thorst has joined #openstack-infra | 17:54 | |
| *** thorst has quit IRC | 17:58 | |
| *** thorst has joined #openstack-infra | 17:59 | |
| *** baoli has quit IRC | 17:59 | |
| *** baoli has joined #openstack-infra | 18:01 | |
| *** baoli has quit IRC | 18:01 | |
| *** felipemonteiro has joined #openstack-infra | 18:01 | |
| *** Apoorva_ has joined #openstack-infra | 18:01 | |
| *** felipemonteiro_ has joined #openstack-infra | 18:02 | |
| clarkb | odyssey4me: hey noticed that periodic os ansible jobs hit http://logs.openstack.org/periodic/periodic-openstack-ansible-upgrade-ceph-master-ubuntu-xenial/ecc2d59/console.html#_2017-08-15_07_26_03_376527 other jobs were hitting that in the past (tracked by http://status.openstack.org/elastic-recheck/#1449136) but now with much more stable mirrors in place your jobs seem to be the only ones | 18:04 |
| *** Apoorva has quit IRC | 18:04 | |
| clarkb | odyssey4me: justthought I'd point it out as maybe your job is firewalling things off or otherwise preventing the job from going out to the mirror to find that one package on upgrade? | 18:04 |
| *** felipemonteiro has quit IRC | 18:05 | |
| *** electrofelix has quit IRC | 18:06 | |
| *** pvaneck has joined #openstack-infra | 18:09 | |
| *** baoli has joined #openstack-infra | 18:10 | |
| *** esberglu_lunch is now known as esberglu | 18:11 | |
| AJaeger | jeblair: https://review.openstack.org/#/c/492715 is still not in the gate. I just toggled my +W | 18:11 |
| *** rbrndt has joined #openstack-infra | 18:13 | |
| openstackgerrit | Ryan proposed openstack-infra/bindep master: Add ability to list all deps https://review.openstack.org/492693 | 18:15 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Create a whitelist for /etc configs https://review.openstack.org/493973 | 18:16 |
| *** jamesde__ has joined #openstack-infra | 18:17 | |
| *** jamesdenton has quit IRC | 18:18 | |
| *** jamesmcarthur has quit IRC | 18:20 | |
| *** eharney has quit IRC | 18:21 | |
| *** eharney has joined #openstack-infra | 18:21 | |
| *** Apoorva_ has quit IRC | 18:22 | |
| *** Apoorva has joined #openstack-infra | 18:22 | |
| *** jamesmcarthur has joined #openstack-infra | 18:22 | |
| *** baoli has quit IRC | 18:23 | |
| *** baoli has joined #openstack-infra | 18:23 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add devstack-gate repo to zuul v3 https://review.openstack.org/493974 | 18:25 |
| *** tdasilva has joined #openstack-infra | 18:25 | |
| *** jamesmcarthur has quit IRC | 18:29 | |
| *** e0ne has quit IRC | 18:29 | |
| *** jamesmcarthur has joined #openstack-infra | 18:32 | |
| pabelanger | fungi: clarkb: new mirror.sto2.citycloud was launched this morning, but haven't changed DNS. Do we want to try that now? It is a 4C/8GB server now | 18:38 |
| clarkb | pabelanger: meeting is coming up but I think thats probably a relatively safe change | 18:38 |
| clarkb | (since servers are largely stateless) | 18:38 |
| pabelanger | clarkb: agree, I'll update DNS now | 18:39 |
| openstackgerrit | Ryan proposed openstack-infra/bindep master: Add ability to list all deps https://review.openstack.org/492693 | 18:39 |
| openstackgerrit | Merged openstack-infra/project-config master: Add devstack-gate repo to zuul v3 https://review.openstack.org/493974 | 18:41 |
| pabelanger | #status log mirror.sto2.citycloud.o.o DNS updated to 46.254.11.19 TTL 60 | 18:42 |
| openstackstatus | pabelanger: finished logging | 18:42 |
| *** eranrom has quit IRC | 18:43 | |
| *** Guest76967 has quit IRC | 18:44 | |
| *** nicolasbock has quit IRC | 18:49 | |
| clarkb | infra team meeting in #openstack-meeting in 2 minutes (1900UTC) | 18:58 |
| *** Hal has joined #openstack-infra | 18:59 | |
| *** eranrom has joined #openstack-infra | 18:59 | |
| *** Hal is now known as Guest41024 | 18:59 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/project-config master: jenkins: jobs: ansible-role-jobs: Increase job timeout to 90 minutes https://review.openstack.org/493986 | 18:59 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/elastic-recheck master: grenade: wait for service logs before matching against patterns https://review.openstack.org/493987 | 19:00 |
| *** EricGonczer_ has joined #openstack-infra | 19:01 | |
| ihrachys_ | ideas on why no logs were collected in http://logs.openstack.org/38/490638/1/check/gate-tempest-dsvm-neutron-dvr-ubuntu-xenial/e62906e/ except console? | 19:02 |
| *** ihrachys_ is now known as ihrachys | 19:02 | |
| *** baoli has quit IRC | 19:03 | |
| *** jamesde__ has quit IRC | 19:03 | |
| *** srobert has quit IRC | 19:03 | |
| *** tosky has quit IRC | 19:03 | |
| *** jkilpatr has quit IRC | 19:03 | |
| *** sbezverk has quit IRC | 19:03 | |
| *** xyang1 has quit IRC | 19:03 | |
| *** hongbin has quit IRC | 19:03 | |
| *** chlong_ has quit IRC | 19:03 | |
| *** gouthamr has quit IRC | 19:03 | |
| *** niska has quit IRC | 19:03 | |
| *** leifmadsen has quit IRC | 19:03 | |
| *** d0ugal has quit IRC | 19:03 | |
| *** andymccr has quit IRC | 19:03 | |
| *** hongbin has joined #openstack-infra | 19:03 | |
| *** niska has joined #openstack-infra | 19:03 | |
| *** tosky has joined #openstack-infra | 19:03 | |
| *** xyang1 has joined #openstack-infra | 19:03 | |
| *** andymccr_ has joined #openstack-infra | 19:03 | |
| *** baoli has joined #openstack-infra | 19:03 | |
| *** jamesdenton has joined #openstack-infra | 19:03 | |
| *** andreww has quit IRC | 19:03 | |
| *** d0ugal has joined #openstack-infra | 19:03 | |
| *** leifmadsen has joined #openstack-infra | 19:04 | |
| *** srobert has joined #openstack-infra | 19:04 | |
| *** tnovacik has joined #openstack-infra | 19:04 | |
| *** andreww has joined #openstack-infra | 19:04 | |
| *** chlong_ has joined #openstack-infra | 19:04 | |
| *** gouthamr has joined #openstack-infra | 19:04 | |
| *** jkilpatr has joined #openstack-infra | 19:04 | |
| *** tnovacik has quit IRC | 19:08 | |
| *** gouthamr has quit IRC | 19:12 | |
| seanhandley | Any advice on how I can register #openstack-publiccloud as a channel? The support people in #freenode say I need to find the group contact for #openstack-* | 19:18 |
| *** castulo has joined #openstack-infra | 19:18 | |
| seanhandley | I ask because this change is failing https://review.openstack.org/#/c/493934/ | 19:18 |
| seanhandley | The offending error is "#openstack-publiccloud is not registered with ChanServ." | 19:18 |
| seanhandley | but when I try to register it myself with /msg ChanServ, I get told I'm not allowed because I'm not an op in the channel | 19:19 |
| seanhandley | (but nobody else is an op, and I've no idea who originally created it) | 19:19 |
| *** EricGonczer_ has quit IRC | 19:20 | |
| *** EricGonczer_ has joined #openstack-infra | 19:21 | |
| *** signed8bit has quit IRC | 19:22 | |
| AJaeger | seanhandley: http://docs.openstack.org/infra/system-config/irc.html explains it | 19:24 |
| AJaeger | seanhandley: the Infra Manual links to that page, it's always a good start... | 19:24 |
| seanhandley | I read it AJaeger | 19:25 |
| seanhandley | it's not working for me | 19:25 |
| AJaeger | https://docs.openstack.org/infra/manual/creators.html#configure-gerritbot-to-announce-changes | 19:25 |
| AJaeger | seanhandley: so, who created the channel? | 19:25 |
| seanhandley | ChanServYou must be a channel operator in #openstack-publiccloud in order to register it. | 19:25 |
| seanhandley | I don't know AJaeger | 19:26 |
| seanhandley | I've been asking in #freenode how to find out and they say it's not possible | 19:26 |
| AJaeger | seanhandley: is anybody using that channel at all? Let me check | 19:26 |
| seanhandley | Yeah I'm in there now | 19:27 |
| seanhandley | we've been using it a while for conversations | 19:27 |
| seanhandley | and I want gerrit messages to appear there | 19:27 |
| AJaeger | seanhandley: one of the admins should be able to help you - but we have right now the team meeting, so ask again at the hour, please | 19:27 |
| *** jangutter has quit IRC | 19:27 | |
| AJaeger | seanhandley: but the first person entering it did not register it ;( | 19:27 |
| seanhandley | AJaeger: It would seem so | 19:28 |
| seanhandley | and I don't know who registered it | 19:28 |
| AJaeger | seanhandley: nobody registered - but the admins here can help but are not listening in for the next 30 mins... | 19:28 |
| seanhandley | well, I mean I don't know who fist joined it and brought it into existence :) | 19:30 |
| seanhandley | ok, I'll circle back | 19:30 |
| seanhandley | thanks o/ | 19:30 |
| *** ociuhandu has joined #openstack-infra | 19:34 | |
| openstackgerrit | Kristi Nikolla proposed openstack-infra/project-config master: Remove uwsgi job for keystone https://review.openstack.org/494004 | 19:39 |
| ianw | [Tue Aug 15 09:33:48.088025 2017] [core:notice] [pid 25379:tid 140611876820864] AH00052: child pid 31713 exit signal Segmentation fault (11) | 19:39 |
| pabelanger | ianw: oh, that would explain it | 19:40 |
| ianw | 2017-08-15 09:33:48.464417 | INFO:kolla.image.build.zun-base | 19:40 |
| ianw | there's a few of these ... but annoyingly on the mirror, each one i guess represents a gate failure | 19:40 |
| AJaeger | team, could one of you +2A this project-config change for the magnum team, please? https://review.openstack.org/#/c/493556/ | 19:41 |
| clarkb | seanhandley: if you get everyone to exit the channel then you can register it. Otherwise I think jeblair is who you will need to register it as a #openstack-* admin on freenode | 19:41 |
| ianw | pabelanger: http://paste.openstack.org/show/618438/ | 19:41 |
| clarkb | AJaeger: can you review 494004 as well (handy because it removes a job and we have less capacity now) | 19:41 |
| pabelanger | ianw: yum client should try up to 10 times to fetch the RPM. Maybe we need to make it smarter? | 19:41 |
| ianw | i'm not seeing the "scoreboard is full" errors we've seen before | 19:41 |
| pabelanger | ianw: which server is that? | 19:41 |
| clarkb | ianw: should we attempt switching the mpm worker type? | 19:41 |
| clarkb | AJaeger: heh that commit message isn't so nice... | 19:42 |
| AJaeger | this removes all the newton periodic translations jobs - any reviewers? https://review.openstack.org/493757 | 19:42 |
| *** eroux has joined #openstack-infra | 19:42 | |
| clarkb | AJaeger: ya I'll review that one too | 19:42 |
| ianw | pabelanger: iad.rax based on -> 2017-08-15 09:33:48.464417 | INFO:kolla.image.build.zun-base:http://mirror.iad.rax.openstack.org/centos/7/os/x86_64/Packages/centos-logos-70.0.6-3.el7.centos.noarch.rpm: [Errno 14] curl#18 - "transfer closed with 4024836 bytes remaining to read | 19:42 |
| jeblair | seanhandley: yes, please let me know if you're unable to get everyone to leave the channel (asking individually helps) | 19:43 |
| ianw | seeing as it got hung up on, i'm not sure what the retry policy is | 19:43 |
| pabelanger | AJaeger: clarkb: would be good to see what is failing. I know they have issue with atomic fedora ISO, but they should be mirrored now | 19:43 |
| AJaeger | clarkb: +3 for the uwsgi one - thanks for reviewing | 19:43 |
| AJaeger | Seems strigazi_OFF is not around anymore ;/ | 19:43 |
| pabelanger | ianw: thanks, missed that | 19:44 |
| ianw | clarkb: possibly on the worker mpm? or xenial upgrade to get new apache ... | 19:44 |
| AJaeger | pabelanger: one example http://logs.openstack.org/81/491381/2/check/gate-functional-dsvm-magnum-k8s-ubuntu-xenial/a93deff/console.html | 19:44 |
| clarkb | jeblair: did the mtl01 new mirror get booted xenial? | 19:44 |
| pabelanger | upgrade to xenial should be straightfoward | 19:44 |
| clarkb | if so thinking that may be the best strategy since we have to upgrade eventually anyways | 19:44 |
| jeblair | clarkb: yes | 19:45 |
| ianw | what's that about known unknowns and unknown unknowns :) | 19:45 |
| ianw | hopefully it doesn't cause more problems than it solves | 19:45 |
| jeblair | does this mean i can hand inap replacement off to someone else? i would love that | 19:45 |
| jeblair | all changes are staged, i'm just too scatterbrained to merge/watch them now | 19:45 |
| clarkb | AJaeger: both changes reviewed. I'm going to grab lunch now | 19:46 |
| pabelanger | AJaeger: ya, don't see anything obvious. Would have to read up more on job | 19:46 |
| jeblair | i just set them all to topic:inap | 19:46 |
| clarkb | ianw: pabelanger jeblair I can help with replacing the servers with xenial (including finishing up inap name change) might be good to have a couple people doing it as it should go fairly quickly in that case | 19:46 |
| clarkb | jeblair: thanks | 19:46 |
| clarkb | ok really lunch now | 19:46 |
| pabelanger | ++ | 19:47 |
| AJaeger | pabelanger: looking at http://logs.openstack.org/81/491381/2/check/gate-functional-dsvm-magnum-k8s-ubuntu-xenial/023881a/console.html#_2017-08-15_15_33_30_081538 - the devstack-vm-gate.sh takes 30 mins. Is that normal? | 19:47 |
| ianw | clarkb / pabelanger: i'm pretty sure i dug into this before in different contexts -> https://bugs.launchpad.net/ubuntu/+source/apache2/+bug/1630413 | 19:47 |
| openstack | Launchpad bug 1630413 in apache2 (Ubuntu) "segfault in server/mpm/event/event.c:process_socket" [Undecided,New] | 19:47 |
| AJaeger | clarkb: enjoy! | 19:47 |
| AJaeger | pabelanger: for timeouts see also https://review.openstack.org/#/c/493986/ | 19:49 |
| pabelanger | ianw: clarkb: the other thing I was thinking of, was setup a mirrorlist for yum client, meaning it it does have an issue with regional mirror, try moving to another cloud or directly upstream | 19:49 |
| AJaeger | and https://review.openstack.org/493092 also asks for timeout change | 19:50 |
| pabelanger | AJaeger: need to know which cloud it was running on | 19:50 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Zuulv3: capitalize more things https://review.openstack.org/494006 | 19:50 |
| dims | clarkb : on that pike->master grenade review, got to the point where tempest runs fine except for 2 failures - both SSH timeout(s), that too only on multinode. any thoughts? | 19:50 |
| pabelanger | AJaeger: because both infracloud and citycloud-lon1 were having serious IO / networking issues | 19:50 |
| pabelanger | AJaeger: it is also possible, these jobs just need to use our regional mirrors more | 19:51 |
| jeblair | pabelanger, AJaeger: https://review.openstack.org/494006 should fix the gate issue | 19:51 |
| *** eranrom has quit IRC | 19:51 | |
| pabelanger | +2 thanks | 19:51 |
| AJaeger | jeblair: +3 thanks | 19:51 |
| AJaeger | pabelanger: Let me add comments... | 19:51 |
| *** slaweq has joined #openstack-infra | 19:51 | |
| ianw | pabelanger: yeah, it is a single point of failure ... but otoh really it should just be serving up a file which doesn't seem like it would be that hard to do reliably :) | 19:52 |
| *** gouthamr has joined #openstack-infra | 19:52 | |
| AJaeger | ianw, pabelanger : Here's a fedora related change - do you want to review? https://review.openstack.org/493643 | 19:53 |
| *** dklyle has joined #openstack-infra | 19:53 | |
| clarkb | pabelanger: or maybe even just have it try a few times if segfaults are the problem | 19:54 |
| clarkb | dims: if you share links I can look after lunch | 19:55 |
| dims | clarkb : thanks! http://logs.openstack.org/57/493057/12/check/gate-grenade-dsvm-neutron-multinode-ubuntu-xenial/07b8f83/logs/grenade.sh.txt.gz#_2017-08-15_18_12_20_736 | 19:55 |
| ianw | [Tue Aug 15 09:41:07 2017] afs: disk cache read error in CacheItems slot 367868 off 29429460/125000020 code -4/80 | 19:56 |
| ianw | [Tue Aug 15 09:41:07.550717 2017] [core:notice] [pid 25379:tid 140611876820864] AH00052: child pid 26230 exit signal Segmentation fault (11) | 19:56 |
| ianw | clarkb / pabelanger: ^ that looks extremely suspicious | 19:57 |
| *** gouthamr has quit IRC | 19:57 | |
| *** david-lyle has quit IRC | 19:57 | |
| *** gouthamr has joined #openstack-infra | 19:57 | |
| openstackgerrit | Merged openstack-infra/project-config master: [magnum] Make swarm-mode and k8s tests -nv https://review.openstack.org/493556 | 19:58 |
| *** gouthamr has quit IRC | 19:58 | |
| *** rlandy is now known as rlandy|brb | 19:58 | |
| ianw | it's always a little worrying when you google an afs error message, and the only hit you get is in afs_dcache.c | 19:58 |
| openstackgerrit | Merged openstack-infra/project-config master: Disable Newton translations https://review.openstack.org/493757 | 19:58 |
| *** gouthamr has joined #openstack-infra | 19:59 | |
| fungi | jeblair: clarkb: mordred: pabelanger: plan for 493918 sounds great to me | 20:00 |
| seanhandley | ok thanks jeblair | 20:00 |
| seanhandley | We're spread across timezones | 20:00 |
| seanhandley | if you're able to register it as part of #openstack-* then I'd appreciate it. | 20:01 |
| *** gouthamr has quit IRC | 20:01 | |
| *** slaweq has quit IRC | 20:02 | |
| *** slaweq has joined #openstack-infra | 20:03 | |
| *** tnovacik has joined #openstack-infra | 20:03 | |
| AJaeger | seanhandley: you can all leave in 24 hours ;) | 20:03 |
| AJaeger | if nobody is off... | 20:03 |
| openstackgerrit | Merged openstack-infra/project-config master: Skip yum-config-manager on Fedora https://review.openstack.org/493643 | 20:04 |
| seanhandley | if I can find the person who originally made the channel before registering it | 20:05 |
| seanhandley | then they should be able to register it, right? | 20:05 |
| *** slaweq has quit IRC | 20:06 | |
| *** slaweq_ has joined #openstack-infra | 20:07 | |
| jeblair | seanhandley: not any more. someone has to be a channel operator to register it. the first person in a channel becomes an operator automatically, but there are none now. | 20:07 |
| fungi | seanhandley: only if they retained operator status on it, i believe. if they left and reentered the channel later once there were other people in it that won't work | 20:07 |
| seanhandley | ahh I see | 20:07 |
| seanhandley | gotta love these edge cases | 20:07 |
| fungi | also, i am now caught back up on scrollback and the meeting log | 20:07 |
| jeblair | seanhandley: while we work on fixing this -- how could we avoid this happening again in the future? is there some place where we are missing a pointer to our documentation on creating a channel? | 20:07 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove uwsgi job for keystone https://review.openstack.org/494004 | 20:08 |
| *** krtaylor has quit IRC | 20:08 | |
| seanhandley | jeblair: I guess it'd be worth having a troubleshooting section on https://docs.openstack.org/infra/system-config/irc.html that explains what to do if you can't register a channel? | 20:09 |
| jeblair | seanhandley: yes, but i mean, how can we get the word out to folks to work with the infra team to set up new irc channels? | 20:09 |
| jeblair | because this is the fallback procedure when somethig goes wrong; i'd like it to go right the first time :) | 20:09 |
| seanhandley | I guess it's not too uncommon for a WG to form and be in contact on IRC before setting up project_config stuff | 20:09 |
| seanhandley | ahh | 20:10 |
| jeblair | seanhandley: right, so how should we change that? | 20:10 |
| seanhandley | That's a toughie - people get excited and make channels so they can start talking and making things | 20:10 |
| jeblair | like, how to we communicate to folks who are forming a WG what the process is? | 20:10 |
| seanhandley | it's easier to instruct people on what to do if, rather than "don't do this if" - because the don't know they're on some controlled path with pitfalls if they take a different route | 20:11 |
| openstackgerrit | Merged openstack-infra/project-config master: Zuulv3: capitalize more things https://review.openstack.org/494006 | 20:11 |
| seanhandley | hmm | 20:11 |
| seanhandley | tbh I don't think I've read any "How to form an OpenStack WG doc" ? | 20:11 |
| *** slaweq_ has quit IRC | 20:11 | |
| seanhandley | Though it's been a long day, and I may be wrong | 20:11 |
| jeblair | seanhandley: right. we wrote a "how to set up a project" guide. maybe our community needs a "how to set up a WG guide"? maybe in the project team guide? (maybe there is one and i missed it? i've been heads down in some stuff recently...) | 20:11 |
| *** sbezverk has joined #openstack-infra | 20:12 | |
| seanhandley | I don't remember seeing one - we just got talking, emailing, chatting on IRC and gained momentum organically | 20:12 |
| ianw | pabelanger: https://github.com/openafs/openafs/blob/master/src/afs/afs_dcache.c#L2892 <- it seems like we got a -4 from the vfs layers, presumably EINTR. does the actually cause more problems? who knows | 20:12 |
| seanhandley | we set up a project so we could create specs for the work we want to do | 20:12 |
| seanhandley | I suspect it's the kind of thing that happens infrequently enough for anyone to have really nailed down the UX | 20:13 |
| ianw | clarkb: does xenial come with a different afs? although, most of that code hasn't changed for 20 years it seems | 20:13 |
| seanhandley | jeblair: I need to head off (it's getting late in the UK and I have to travel tomorrow) | 20:14 |
| jeblair | seanhandley: ya. and i mean, we don't want to layer too much bureaucracy on it. so maybe we can make a short section in the ptg we can point folks to. | 20:14 |
| jeblair | seanhandley: ok, i should have this set up in just a few more minutes | 20:14 |
| jeblair | seanhandley: good night! | 20:15 |
| pabelanger | ianw: that is a cinder volume right? | 20:15 |
| seanhandley | thanks jeblair - catch you later o/ | 20:15 |
| clarkb | ianw: jeblair and mordred grok that stuff best | 20:16 |
| openstackgerrit | Merged openstack-infra/infra-specs master: Move zuul_split to completed https://review.openstack.org/482422 | 20:18 |
| fungi | it's a shame russ doesn't hang out in irc, or we could feed him all sorts of interesting openafs debugging cases | 20:19 |
| *** thorre_se has joined #openstack-infra | 20:19 | |
| jeblair | ianw: i'm not sure | 20:19 |
| jeblair | but we can check | 20:19 |
| jeblair | ianw: 1.6.15 vs 1.6.7 | 20:20 |
| *** rlandy|brb is now known as rlandy | 20:21 | |
| ianw | pabelanger: hmm, good point --> afs's layers to vfs to volume mounted via cinder. that's some layers... | 20:21 |
| ianw | sprinkle a little kvm/xen throughout | 20:21 |
| *** thorre has quit IRC | 20:22 | |
| *** thorre_se is now known as thorre | 20:22 | |
| jeblair | ianw: it's worth entertaining the possibility cause and effect are reversed. it's possible that the segfault to apache caused EINTR to be returned (as EINTR can be returned when an application gets a signal). | 20:23 |
| ianw | jeblair: true. we really should switch on sub-second iso timestamps for apache, that syslog format is so annoying | 20:24 |
| *** e0ne has joined #openstack-infra | 20:24 | |
| *** gouthamr has joined #openstack-infra | 20:24 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add test job for watcher with split tempest plugin https://review.openstack.org/490375 | 20:25 |
| *** srobert has quit IRC | 20:27 | |
| *** EricGonczer_ has quit IRC | 20:29 | |
| *** EricGonczer_ has joined #openstack-infra | 20:29 | |
| *** Apoorva_ has joined #openstack-infra | 20:31 | |
| *** jamesmcarthur has quit IRC | 20:34 | |
| *** Apoorva has quit IRC | 20:34 | |
| ianw | pabelanger / clarkb / jeblair : so, in summary, it seems clear something gets apache unhappy (http://paste.openstack.org/show/618438/), which kills transfers and fails jobs. either apache itself, or afs (possibly due to cache on a cinder volume) | 20:35 |
| ianw | it doesn't seem worth us expending great effort debugging this on trusty | 20:35 |
| pabelanger | #status log created auto hold for gate-tripleo-ci-centos-7-containers-multinode to debug docker.io issues with reverse proxy | 20:35 |
| openstackstatus | pabelanger: finished logging | 20:35 |
| ianw | so i'd propose we swap rax.iad mirror with a xenial based one, and monitor for some time for these issues | 20:37 |
| *** slaweq has joined #openstack-infra | 20:37 | |
| ianw | if we're still seeing it, then we can put the effort in to root cause it | 20:37 |
| *** claudiub has joined #openstack-infra | 20:37 | |
| *** e0ne has quit IRC | 20:37 | |
| jeblair | ianw: ++ | 20:39 |
| jeblair | ianw: does it happen on non-rax servers? | 20:39 |
| pabelanger | ianw: so, if we can have yum retry the attempt on broken connection, that would help. The default is 10 times, I wonder if we need to bump because apache is still down | 20:40 |
| pabelanger | ianw: happy to try xenail ++ | 20:40 |
| ianw | pabelanger: i think the retry is if it can't connect, more than if it does connect, but gets cut off | 20:40 |
| *** slaweq has quit IRC | 20:42 | |
| ianw | jeblair: i had seen similar things on lon mirror server, but that was also very unhealthy. i can do a bit of a log audit later | 20:42 |
| pabelanger | ianw: right, I would think yum would retry another mirror, if connection broke. But I am gessing | 20:42 |
| pabelanger | guessing* | 20:42 |
| clarkb | ianw: oh interesting re possibly on cinder volume | 20:47 |
| clarkb | ianw: plan sounds good to me | 20:47 |
| *** sbezverk has quit IRC | 20:47 | |
| clarkb | dims: ok I'm looking at it now | 20:47 |
| clarkb | dims: the first thing I look at with this type of failure is did the instance console log show that it ste up an ip address. It did 10.1.0.9. Next I notice that the server actually was assigned two fixed IPs. 10.1.0.5 and 10.1.0.9 however the intsance only seems to know about 10.1.0.9. If the floating IP attached to the .5 address that may explain it | 20:52 |
| *** gouthamr has quit IRC | 20:53 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Test that secrets don't leak into logs https://review.openstack.org/494015 | 20:54 |
| *** trown is now known as trown|outtypewww | 20:54 | |
| *** rcernin has joined #openstack-infra | 20:54 | |
| clarkb | dims: currently trying to track where the fip was attached | 20:54 |
| dims | thanks clarkb, i got lost (and don't understand this side much) | 20:55 |
| clarkb | dims: maybe you can try to figure out why it got two IPs? that seems like a big since I don't think cirros image supports that | 20:56 |
| *** jcoufal has quit IRC | 20:56 | |
| clarkb | dims: and confirmed http://logs.openstack.org/57/493057/12/check/gate-grenade-dsvm-neutron-multinode-ubuntu-xenial/07b8f83/logs/screen-q-svc.txt.gz#_Aug_15_18_08_36_271636 it appears to have attached to the wrong IPs | 20:56 |
| clarkb | dims: grep for 'Lease of 10.1.0.9 obtained, lease time 86400' in the grenade log to see where it picked 10.1.0.9 and not 10.1.0.5 | 20:57 |
| dims | will do in a little bit clarkb, thanks for the pointers | 20:58 |
| *** Swami has joined #openstack-infra | 21:00 | |
| *** baoli has quit IRC | 21:00 | |
| *** baoli has joined #openstack-infra | 21:01 | |
| castulo | hi guys, good afternoon, I am trying to setup my own gerritbot using openstack-infra/gerritbot but I haven't been able to make it work. When I run gerritbot /path/to/my/config it doesn't show any error but it doesn't seem to do nothing, does it create a log file I could look at somewhere? | 21:03 |
| *** xyang1 has quit IRC | 21:06 | |
| *** baoli has quit IRC | 21:06 | |
| *** tnovacik has quit IRC | 21:07 | |
| *** Apoorva_ has quit IRC | 21:10 | |
| *** Apoorva has joined #openstack-infra | 21:10 | |
| openstackgerrit | Gage Hugo proposed openstack-infra/project-config master: Skip integration tests/non-doc jobs for doc only changes https://review.openstack.org/494018 | 21:12 |
| *** Julien-zte has quit IRC | 21:12 | |
| *** Julien-zte has joined #openstack-infra | 21:13 | |
| *** Julien-zte has quit IRC | 21:13 | |
| *** Julien-zte has joined #openstack-infra | 21:14 | |
| *** dprince has quit IRC | 21:14 | |
| *** jcoufal has joined #openstack-infra | 21:16 | |
| openstackgerrit | Gage Hugo proposed openstack-infra/project-config master: Skip integration/non-doc jobs in certain cases https://review.openstack.org/494018 | 21:17 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: NODEPOOL_DOCKER_REGISTRY_PROXY needs trailing slash for docker https://review.openstack.org/494021 | 21:23 |
| pabelanger | clarkb: ianw: mind a +2 / +3 ^, that is our fix to get docker client to properly use mirror | 21:25 |
| pabelanger | err, reverse proxy cache | 21:25 |
| *** jcoufal_ has joined #openstack-infra | 21:25 | |
| *** mordred has quit IRC | 21:27 | |
| *** mordred has joined #openstack-infra | 21:27 | |
| *** jcoufal has quit IRC | 21:28 | |
| *** vhosakot has quit IRC | 21:28 | |
| *** jcoufal_ has quit IRC | 21:29 | |
| *** esberglu has quit IRC | 21:31 | |
| *** priteau has quit IRC | 21:32 | |
| *** esberglu has joined #openstack-infra | 21:32 | |
| *** ldnunes has quit IRC | 21:32 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Exclude list for logs collection https://review.openstack.org/494022 | 21:34 |
| *** askb has joined #openstack-infra | 21:34 | |
| *** vhosakot has joined #openstack-infra | 21:35 | |
| pabelanger | infra-root: do you all mind adding https://review.openstack.org/492671 do your review pipeline. I'd like to confirm everybody is happy with moving forward on testing the secrets, zuulv3-dev.o.o and tarball uploads | 21:36 |
| *** esberglu has quit IRC | 21:36 | |
| clarkb | pabelanger: just commented on it | 21:36 |
| *** slaweq has joined #openstack-infra | 21:38 | |
| pabelanger | clarkb: thanks, fixing | 21:38 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create site_zuulv3_dev secret https://review.openstack.org/492671 | 21:39 |
| pabelanger | clarkb: know if you can template hosts ? | 21:39 |
| *** bh526r has quit IRC | 21:39 | |
| pabelanger | never tried myself | 21:40 |
| clarkb | pabelanger: I do not | 21:40 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create site_zuulv3_dev secret https://review.openstack.org/492671 | 21:40 |
| pabelanger | clarkb: k, pushed it up to try | 21:40 |
| clarkb | I think it should work because the whole file is jina2'd right? | 21:40 |
| pabelanger | Ya, hopefully | 21:40 |
| clarkb | mordred: rcarrillocruz ^ may know | 21:40 |
| openstackgerrit | Gage Hugo proposed openstack-infra/project-config master: Skip integration/non-doc jobs in certain cases https://review.openstack.org/494018 | 21:41 |
| clarkb | pabelanger: I only see the one file updated | 21:42 |
| clarkb | pabelanger: the secrets content didn't get pushed? | 21:42 |
| pabelanger | clarkb: I pushed 2 patches | 21:42 |
| clarkb | oh I commented on 6 not 7 | 21:42 |
| clarkb | sorry for noise | 21:42 |
| pabelanger | np. thanks for review! | 21:42 |
| clarkb | +2 thanks | 21:43 |
| * fungi takes a look now that it's filtered through clarkb | 21:43 | |
| *** slaweq has quit IRC | 21:43 | |
| fungi | not really (i was already starting to look at it), just glad he got to ask confused questions instead of me for a change | 21:44 |
| *** esberglu has joined #openstack-infra | 21:45 | |
| *** ccamacho has left #openstack-infra | 21:45 | |
| *** esberglu has quit IRC | 21:45 | |
| *** esberglu has joined #openstack-infra | 21:45 | |
| fungi | neat that we only briefly add and then remove the file so it doesn't stick around indefinitely | 21:45 |
| fungi | just long enough to prime the agent | 21:46 |
| openstackgerrit | Merged openstack-infra/project-config master: NODEPOOL_DOCKER_REGISTRY_PROXY needs trailing slash for docker https://review.openstack.org/494021 | 21:46 |
| fungi | as an added tinfoil hat measure, should we shred the file before deletion? | 21:46 |
| fungi | i know that's not foolproof either, just a bit of added defense-in-depth maybe | 21:46 |
| pabelanger | we could also do that | 21:51 |
| clarkb | anyone else willing to review https://review.openstack.org/#/c/493658/ its a quick one to make our images more easily mangeable | 21:52 |
| fungi | lgtm, package name matches what i expected | 21:52 |
| clarkb | fungi: is there more ptg prep we need to be doing? I assume you've given organizers rough room sizes? | 21:55 |
| clarkb | I seem to have lost my ptg ideas etherpad tab | 21:55 |
| openstackgerrit | Merged openstack-infra/shade master: Make get_server_console tests more resilient https://review.openstack.org/492683 | 21:57 |
| fungi | clarkb: yeah, that was based on early attendance estimates (which i padded by maybe two just in case) | 21:57 |
| pabelanger | [Tue Aug 15 20:25:51.183969 2017] [core:notice] [pid 9788:tid 140692973217664] AH00051: child pid 11149 exit signal Segmentation fault (11), possible coredump in /etc/apache2 | 21:57 |
| pabelanger | clarkb: ianw: that was on kna1 mirror | 21:57 |
| clarkb | pabelanger: ianw and we don't use cinder volumes there | 21:57 |
| fungi | clarkb: https://etherpad.openstack.org/p/infra-ptg-queens | 21:57 |
| clarkb | fungi: thanks | 21:58 |
| fungi | looks like someone (maybe pabelanger?) added a new possibility regarding py3k support | 21:58 |
| fungi | ahh, no, someone else with a similar color to pabelanger but who is not in the pad, maybe | 21:59 |
| pabelanger | ya, not I | 21:59 |
| fungi | maybe it was the same person who raised it on the -dev ml | 21:59 |
| pabelanger | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=64085&rra_id=all | 22:00 |
| pabelanger | can see where apache died | 22:00 |
| clarkb | and that happaned on the larger flavor too right? | 22:00 |
| pabelanger | yes | 22:01 |
| clarkb | definitely seems like updating software is probably a good idea then | 22:01 |
| pabelanger | we also have a swap, I manually created it on that server | 22:01 |
| clarkb | I think rax trips on this more often right so probably est to stick with the plan and upgrade there first | 22:01 |
| openstackgerrit | Merged openstack-infra/project-config master: Add acpid to infra images https://review.openstack.org/493658 | 22:01 |
| clarkb | another thing we can try if that doesn't fix it is using nginx | 22:01 |
| clarkb | or $otherwebserver | 22:01 |
| clarkb | if its some apache specific behavior that triggers it | 22:02 |
| pabelanger | clarkb: clearly we need load balancing now :) | 22:03 |
| *** eharney has quit IRC | 22:04 | |
| pabelanger | but ya, xenial and mpm worker(?) is a good next step | 22:04 |
| fungi | only if whatever load balancer we layer in front doesn't even worse problems | 22:04 |
| fungi | er, doesn't introduce even worse problems | 22:04 |
| fungi | the upgrade to xenial is also a stab in the dark, sounds like, but it's at least one we'll eventually need to consider anyway | 22:04 |
| pabelanger | fungi: clarkb: ianw: https://review.openstack.org/359278/ would let us generate coredumps | 22:07 |
| pabelanger | did that a while back when we last had apache dying | 22:07 |
| clarkb | fungi: ya I think the idea there is lets upgrade since we need to anyways then worry about debugging these things if they persists | 22:07 |
| clarkb | because otherwise debugging trusty just to upgrade is not worth it | 22:08 |
| *** chlong_ has quit IRC | 22:08 | |
| fungi | i can't disagree with that | 22:08 |
| *** dave-mccowan has quit IRC | 22:08 | |
| *** thorst has quit IRC | 22:12 | |
| *** hongbin has quit IRC | 22:19 | |
| *** felipemonteiro__ has joined #openstack-infra | 22:19 | |
| *** hongbin has joined #openstack-infra | 22:19 | |
| openstackgerrit | Gage Hugo proposed openstack-infra/project-config master: Skip non-doc jobs in certain cases https://review.openstack.org/494027 | 22:19 |
| *** mpjetta has quit IRC | 22:19 | |
| *** clayton has quit IRC | 22:19 | |
| *** rakhmerov has quit IRC | 22:19 | |
| *** mpjetta has joined #openstack-infra | 22:19 | |
| *** felipemonteiro_ has quit IRC | 22:19 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/infra-manual master: Add more content to zuul v3 migration https://review.openstack.org/489691 | 22:19 |
| *** clayton has joined #openstack-infra | 22:19 | |
| *** rakhmerov has joined #openstack-infra | 22:25 | |
| openstackgerrit | Gage Hugo proposed openstack-infra/project-config master: Skip non-doc jobs in certain cases https://review.openstack.org/494027 | 22:25 |
| openstackgerrit | Gage Hugo proposed openstack-infra/project-config master: Skip integration/non-doc jobs in certain cases https://review.openstack.org/494018 | 22:26 |
| ianw | pabelanger: i think i manually applied something like that on static.o.o? | 22:31 |
| *** EricGonczer_ has quit IRC | 22:33 | |
| clarkb | pabelanger: ianw do we need to worry about filling the disk applying that? | 22:33 |
| *** EricGonczer_ has joined #openstack-infra | 22:33 | |
| *** felipemonteiro__ has quit IRC | 22:34 | |
| *** EricGonczer_ has quit IRC | 22:36 | |
| pabelanger | clarkb: ya, HDD should be watched, since we'll be create corefiles | 22:37 |
| *** slaweq has joined #openstack-infra | 22:44 | |
| ianw | might be better to hand apply | 22:44 |
| clarkb | and do we want to wait until we observe it on xenial too (assuming we do?) | 22:44 |
| *** jamesmcarthur has joined #openstack-infra | 22:44 | |
| *** jklare has quit IRC | 22:44 | |
| *** slaweq has quit IRC | 22:44 | |
| ianw | i think so | 22:44 |
| ianw | i will bring up a iad xenial mirror in about 30 min or so | 22:45 |
| clarkb | sounds ood | 22:45 |
| *** jamesmcarthur has quit IRC | 22:45 | |
| clarkb | should we set max-servers in that region to 0 so that we can move the cinder volume? | 22:51 |
| clarkb | that is what fungi did in ord I think | 22:51 |
| fungi | that'll keep the warm cache at least | 22:51 |
| fungi | more for the benefit of afs than apache | 22:51 |
| fungi | also, cinder volumeS | 22:52 |
| fungi | the one for afs was already fully utilized, so i added a second volume to each server for apache (unless the rootfs was large enough to accommodate 100gb for afs and 100gb for apache plus the os and whatnot) | 22:53 |
| clarkb | gotcha | 22:53 |
| *** marst has quit IRC | 22:56 | |
| clarkb | fungi: I marked the python3 ptg idea helproom I think it fits there as I don't expect we'd hack on getting python 3.6 working that week | 22:57 |
| fungi | agreed, that seems like the best fit | 22:58 |
| openstackgerrit | Merged openstack-infra/infra-manual master: Add more content to zuul v3 migration https://review.openstack.org/489691 | 22:58 |
| fungi | though i also don't know that we have much more to say at this point beyond what came up in the ml thread | 22:59 |
| fungi | i guess projects that really want to try their jobs on fedora 26 can do so and run with python 3.6 there | 22:59 |
| clarkb | ya | 22:59 |
| fungi | though i expect for a lot of those jobs, getting them to run on fedora is the harder part, fixing py36-specific issues much less complicated | 23:00 |
| *** SamYaple has quit IRC | 23:00 | |
| *** SamYaple has joined #openstack-infra | 23:00 | |
| openstackgerrit | Merged openstack-infra/system-config master: Disable inactive infra-root accounts https://review.openstack.org/489698 | 23:01 |
| *** hongbin has quit IRC | 23:06 | |
| ianw | fungi: if it's "just" tox type tests, i'd think not too hard | 23:07 |
| *** rcernin has quit IRC | 23:12 | |
| *** thorst has joined #openstack-infra | 23:13 | |
| *** rbrndt has quit IRC | 23:14 | |
| *** rbrndt has joined #openstack-infra | 23:14 | |
| *** rbrndt has quit IRC | 23:14 | |
| ianw | Rackspace is migrating the cloud servers listed below from their current location in our DFW datacenter to another location in the DFW datacenter. You are receiving this message because our automatic live-migration tool failed. -> stackalytics.openstack.org | 23:15 |
| ianw | do we know about that ^ | 23:15 |
| pabelanger | not I, I also can confirm it is down | 23:15 |
| *** thorst has quit IRC | 23:17 | |
| mordred | jeblair, pabelanger, clarkb: do we have any good examples of how to do a notify in puppet when a specific file changes but the thing we're managing is a git repo? | 23:19 |
| ianw | ok, rax thinks it's alive | 23:19 |
| clarkb | mordred: I think you have to do it against the vcsrepo resource | 23:19 |
| ianw | but on the console it's dead "task xenwatch blocked for more than 120 seconds" | 23:20 |
| mordred | clarkb: what if we add a creates[] on the vcsrepo then do a notify on a corresponding file resource? | 23:20 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Test that secrets don't leak into logs https://review.openstack.org/494015 | 23:20 |
| ianw | i'm hard rebooting it | 23:20 |
| mordred | "Change has been successfully merged into the git repository by Zuul" ^^ jeblair | 23:21 |
| clarkb | mordred: is creates a param supported by the vcsrepo resource? I don't think it is | 23:21 |
| mordred | hrm, I think you're right | 23:21 |
| ianw | pabelanger: ok, whatever it does, it's doing it now. do we need it? was this part of an incomplete transition from the .com domain? | 23:22 |
| *** tosky has quit IRC | 23:22 | |
| mordred | what if we just fo File { depends->vcsrepo, notify->reload ... | 23:22 |
| * mordred goes to poke for a second | 23:22 | |
| jeblair | mordred: i assume we have something like that for zuul/layout.yaml ? | 23:25 |
| mordred | jeblair: not that I can find | 23:27 |
| mordred | oh - I think we notify on layout dir | 23:27 |
| *** jklare has joined #openstack-infra | 23:28 | |
| openstackgerrit | Alex Schultz proposed openstack-infra/tripleo-ci master: Revert "Installs openssh packages that try to workaround sshd start problem" https://review.openstack.org/494039 | 23:28 |
| jeblair | mordred: yeah, i think file vs dir is immaterial. i think you can notify on files or dirs even if they're controlled by vcsrepo | 23:29 |
| clarkb | I think that may be a compile error as there is no resource with that name and type managed by puppet | 23:29 |
| mordred | jeblair: ok - so, in v2 we copy files from the project-config git repo when the git repo changes | 23:29 |
| jeblair | mordred: oh, wait i'm wroing about that -- we copy the dir from vcsrepo into place in etc | 23:29 |
| clarkb | what you can do is vcsrepo <- file <- service | 23:29 |
| jeblair | so it's triggering on that copy | 23:29 |
| mordred | yup. then we can notify on that | 23:29 |
| clarkb | where puppet copies the file out of the resource | 23:29 |
| mordred | yah | 23:29 |
| mordred | yup | 23:30 |
| mordred | and we're just putting it in /etc/zuul/layout with the other bits | 23:30 |
| mordred | so - this really should just work - other than v2 does start-stop-daemon signal 1 and in v3 we want to do zuul-scheduler reconfigure yeah? | 23:31 |
| jeblair | mordred: no, we haven't written zuul-rcheduler reconfigure yet | 23:32 |
| jeblair | so it's still sighup | 23:32 |
| jeblair | if that's running and not working, it's a bug | 23:32 |
| mordred | ah. ok. neat. well - let's see if it's working... | 23:33 |
| openstackgerrit | Alex Schultz proposed openstack-infra/tripleo-ci master: Revert "Installs openssh packages that try to workaround sshd start problem" https://review.openstack.org/494039 | 23:34 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci master: Revert "Installs openssh packages that try to workaround sshd start problem" https://review.openstack.org/494040 | 23:35 |
| mordred | jeblair: yup. it's working | 23:37 |
| mordred | jeblair: 2017-08-15 20:11:28,676 INFO zuul.TenantParser: Loading previously parsed configuration from openstack-infra/devstack-gate | 23:37 |
| *** slaweq has joined #openstack-infra | 23:40 | |
| *** rhallisey has quit IRC | 23:41 | |
| *** rlandy has quit IRC | 23:42 | |
| *** thorst has joined #openstack-infra | 23:43 | |
| *** dave-mccowan has joined #openstack-infra | 23:45 | |
| *** slaweq has quit IRC | 23:45 | |
| *** mattmceuen has quit IRC | 23:46 | |
| *** thorst has quit IRC | 23:48 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!