Monday, 2018-02-12

*** pengdake_ has joined #openstack-kolla00:00
*** k_mouza has joined #openstack-kolla00:01
*** mrunge has quit IRC00:02
*** mrunge has joined #openstack-kolla00:05
*** pengdake_ has quit IRC00:06
*** rhallisey has joined #openstack-kolla00:08
*** dardelean has joined #openstack-kolla00:17
*** athomas has quit IRC00:18
*** bmace_ has quit IRC00:23
*** bmace_ has joined #openstack-kolla00:23
*** zhurong has joined #openstack-kolla00:39
*** k_mouza has quit IRC00:44
*** rhallisey has quit IRC00:51
*** caoyuan has joined #openstack-kolla00:54
*** salv-orlando has joined #openstack-kolla00:57
*** zhaochao has joined #openstack-kolla00:59
*** caoyuan has quit IRC01:01
*** JamesBenson has joined #openstack-kolla01:01
*** ansiwen has joined #openstack-kolla01:02
*** salv-orlando has quit IRC01:03
*** JamesBenson has quit IRC01:06
*** dardelean has quit IRC01:15
*** duonghq has joined #openstack-kolla01:20
*** caowei has joined #openstack-kolla01:24
*** yangyapeng has quit IRC01:25
*** yangyapeng has joined #openstack-kolla01:26
*** yangyapeng has quit IRC01:31
*** pengdake_ has joined #openstack-kolla01:31
*** yangyapeng has joined #openstack-kolla01:32
*** dardelean has joined #openstack-kolla01:34
*** yangyapeng has quit IRC01:36
duonghqmorning guys01:37
*** dardelean has quit IRC01:39
duonghqJeffrey4l, did we release rc1?01:51
*** zhurong has quit IRC01:57
*** pengdake_ has quit IRC02:00
*** pengdake_ has joined #openstack-kolla02:00
*** billp has joined #openstack-kolla02:00
*** yangyapeng has joined #openstack-kolla02:02
*** yangyapeng has quit IRC02:05
*** yangyapeng has joined #openstack-kolla02:06
*** hongbin has joined #openstack-kolla02:25
*** kiennt26 has joined #openstack-kolla02:30
*** chmarkus has quit IRC03:02
*** chmarkus has joined #openstack-kolla03:04
*** spsurya has joined #openstack-kolla03:07
spsuryamorning guys03:07
*** ArminderSingh has joined #openstack-kolla03:09
*** itlinux has quit IRC03:10
*** gkadam has joined #openstack-kolla03:40
*** skramaja has joined #openstack-kolla03:47
*** unicell has quit IRC03:55
*** skramaja_ has joined #openstack-kolla03:55
*** skramaja has quit IRC03:56
*** itlinux has joined #openstack-kolla04:02
*** Sean-md has quit IRC04:02
*** gkadam is now known as gkadam-afk04:09
*** dave-mccowan has quit IRC04:10
*** dave-mccowan has joined #openstack-kolla04:12
*** dave-mccowan has quit IRC04:18
*** itlinux has quit IRC04:24
*** itlinux has joined #openstack-kolla04:30
*** pengdake_ has quit IRC04:30
*** xinliang has joined #openstack-kolla04:36
*** gkadam-afk is now known as gkadam04:38
*** lpetrut has joined #openstack-kolla04:39
*** janki has joined #openstack-kolla04:41
*** skramaja_ is now known as skramaja04:43
*** caowei has quit IRC04:53
*** pengdake_ has joined #openstack-kolla04:53
*** hongbin has quit IRC04:56
*** brad[] has quit IRC05:03
*** brad[] has joined #openstack-kolla05:05
*** lpetrut has quit IRC05:07
*** lpetrut has joined #openstack-kolla05:13
*** lpetrut has quit IRC05:15
*** lpetrut has joined #openstack-kolla05:15
*** pengdake_ has quit IRC05:22
*** lpetrut has quit IRC05:31
*** pengdake_ has joined #openstack-kolla05:33
*** olivierbourdon38 has joined #openstack-kolla05:54
*** caoyuan has joined #openstack-kolla05:58
*** caowei has joined #openstack-kolla06:00
*** caoyuan_ has joined #openstack-kolla06:02
*** salv-orlando has joined #openstack-kolla06:03
*** caoyuan has quit IRC06:03
*** olivierbourdon38 has quit IRC06:08
*** caoyuan_ has quit IRC06:08
*** itlinux has quit IRC06:10
*** mnasiadka has joined #openstack-kolla06:14
*** janki has quit IRC06:57
*** janki has joined #openstack-kolla06:57
*** caoyuan has joined #openstack-kolla07:07
Jeffrey4lre rc1, no, this rc1 will be tag around later this month07:14
dtk26th if I recall07:23
duonghqJeffrey4l, thanks07:26
*** ArminderSingh- has joined #openstack-kolla07:26
*** caoyuan has quit IRC07:26
*** caoyuan has joined #openstack-kolla07:26
*** olivierbourdon38 has joined #openstack-kolla07:27
*** lpetrut has joined #openstack-kolla07:29
*** ArminderSingh has quit IRC07:30
openstackgerritMerged openstack/kolla-ansible master: Fix sed command within external mariadb doc  https://review.openstack.org/54237307:35
*** lvdombrkr has joined #openstack-kolla07:37
*** caoyuan has quit IRC07:38
*** caowei has quit IRC07:39
*** egonzalez has joined #openstack-kolla07:40
*** caoyuan has joined #openstack-kolla07:46
*** caoyuan has quit IRC07:51
lvdombrkrrfxn: hi, are you somewhere around>07:55
lvdombrkr?07:55
egonzalezJeffrey4l, ping regarding are we in feature freeze yet?08:01
Jeffrey4legonzalez, yes. until rocky branch is cut08:01
*** dardelean has joined #openstack-kolla08:01
egonzalezJeffrey4l, thanks08:02
Jeffrey4lnp08:02
openstackgerritMerged openstack/kolla-ansible master: Deploy of keystone fails if api_interface names differ  https://review.openstack.org/54294408:04
*** gema has joined #openstack-kolla08:05
*** pcaruana has joined #openstack-kolla08:07
*** b_bezak has joined #openstack-kolla08:07
*** ArminderSingh- has quit IRC08:08
dardeleanhello08:15
*** dciabrin has joined #openstack-kolla08:18
dardeleanegonzalez sent the patchset on friday https://review.openstack.org/#/c/508530/08:22
dardeleanif you want to take a look08:22
*** ArminderSingh has joined #openstack-kolla08:23
*** salv-orlando has quit IRC08:27
egonzalezdardelean, we cannot merge any feature into queens now08:31
egonzalezcode looks good08:31
dardeleanI see08:31
egonzalezdardelean, ping me back once rocky branch is open to change -1 to +208:33
dardeleanwill do, thanks :D08:34
*** k_mouza has joined #openstack-kolla08:36
*** k_mouza has quit IRC08:40
*** kiennt26 has quit IRC08:49
*** lpetrut has quit IRC08:54
*** ktibi has joined #openstack-kolla08:57
openstackgerritAlexandru Bogdan Pica proposed openstack/kolla master: Fix ceilometer deployment  https://review.openstack.org/54248108:57
*** k_mouza has joined #openstack-kolla09:01
*** ktibi has quit IRC09:02
*** ktibi has joined #openstack-kolla09:02
*** k_mouza has quit IRC09:02
*** k_mouza has joined #openstack-kolla09:02
openstackgerritAlexandru Bogdan Pica proposed openstack/kolla master: Fix ceilometer deployment  https://review.openstack.org/54248109:03
openstackgerritJeffrey Zhang proposed openstack/kolla master: [DNM]Seem there are some wrong in infra ubuntu repo  https://review.openstack.org/54338709:08
openstackgerritAlexandru Bogdan Pica proposed openstack/kolla master: Fix ceilometer deployment  https://review.openstack.org/54248109:15
*** zhubingbing_ has quit IRC09:17
*** brad[] has quit IRC09:20
*** jmccarthy has joined #openstack-kolla09:24
*** salv-orlando has joined #openstack-kolla09:28
*** brad[] has joined #openstack-kolla09:32
*** shardy has joined #openstack-kolla09:33
*** salv-orlando has quit IRC09:33
*** dardelean has quit IRC09:38
*** shardy has quit IRC09:43
*** shardy has joined #openstack-kolla09:43
*** dardelean has joined #openstack-kolla09:44
*** hamza21 has joined #openstack-kolla09:45
*** ktibi has quit IRC09:46
*** serlex has joined #openstack-kolla09:47
*** ktibi has joined #openstack-kolla09:51
*** ktibi has quit IRC09:51
*** ktibi has joined #openstack-kolla09:51
*** serlex1 has joined #openstack-kolla09:54
*** serlex1 has left #openstack-kolla09:54
*** serlex has quit IRC09:57
*** zshi has quit IRC10:01
*** pengdake_ has quit IRC10:04
lvdombrkrrfxn: hi, are you somewhere around>10:14
*** zshi has joined #openstack-kolla10:14
*** gfidente has joined #openstack-kolla10:14
*** gfidente has quit IRC10:14
*** gfidente has joined #openstack-kolla10:14
hrwmorning10:19
dardeleanhei10:21
*** alanmeadows has quit IRC10:23
*** alanmeadows has joined #openstack-kolla10:23
*** skramaja has quit IRC10:25
*** salv-orlando has joined #openstack-kolla10:29
*** olivierbourdon38 has quit IRC10:31
*** salv-orlando has quit IRC10:34
lvdombrkrfolks if i have two compute nodes how can i customize each one to use ceph, other to use lvm for example?10:34
egonzalezlvdombrkr, not the best idea to do so, but can set variables per host in the inventory or with hostvars10:37
*** ktibi has quit IRC10:38
lvdombrkregonzalez: can you clarify a little bit how to set variables per host? already i just specify all configs under /etc/kolla/config.. how can i divide that one config is for one host and other for other host? and why is not the best idea?10:41
*** salv-orlando has joined #openstack-kolla10:44
*** ktibi has joined #openstack-kolla10:46
*** mrhillsman has quit IRC10:57
*** mrhillsman has joined #openstack-kolla10:58
*** sambetts|afk is now known as sambetts11:06
*** jaosorior has joined #openstack-kolla11:10
egonzalezlvdombrkr, is not a good idea using lvm and ceph for different compute hosts , how you do vm migration in that case11:18
egonzalezlvdombrkr, in /etc/kolla/config/nova/<inventory_hostname>/nova.conf11:18
egonzalezbut will need to set variables as enable_ceph:" yes" in your inventory file for each host to enable/disable services11:19
egonzalezdont know if will work as expected, not a realistic use case and doubt anyone has tested before that11:19
*** mdnadeem has joined #openstack-kolla11:20
*** mrunge_ has joined #openstack-kolla11:23
*** pbourke has quit IRC11:24
*** mrunge has quit IRC11:25
*** pbourke has joined #openstack-kolla11:26
ktibiHi kolla, I used tempest for test my kolla plateform and I have fail with cinder and https. it's like https://bugs.launchpad.net/cinder/+bug/1713732/comments/111:30
openstackLaunchpad bug 1713732 in Cinder "Tempest failures in tempest.api.volume.test_volumes_list.VolumesListTestJSON" [Undecided,Incomplete]11:30
ktibiworkarround is to add enable_proxy_headers_parsing = True in cinder.conf11:31
ktibiwhen I curl https://openstack:8776, cinder return URL with HTTP :/11:32
*** caowei has joined #openstack-kolla11:37
lvdombrkregonzalez: thanks in assist.. one more question under /var/lib/docker/containers/b6928193aa3c326daa78b299f8ef5e57b899d94b4319160d2a7ca4d1fd747d74/ i have .json.log file which is getting larger and larger, right now its almost 5GB..11:44
egonzalezwhat container is /b6928193aa3c326daa78b299f8ef5e57b899d94b4319160d2a7ca4d1fd747d74 ?11:45
*** skramaja has joined #openstack-kolla11:46
lvdombrkregonzalez: neutron_vpnaas_agent11:46
lvdombrkregonzalez: http://paste.openstack.org/raw/669755/11:48
egonzalezno idea whats the json log for in vpnaas, neutron already have a cron to rotate logs https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/common/templates/cron-logrotate-neutron.conf.j211:53
lvdombrkregonzalez: i thinks its not only this container issue, because same ceph-mon container log also almost 3gb11:58
*** hamza21 has quit IRC12:01
*** ramishra has joined #openstack-kolla12:03
*** rhallisey has joined #openstack-kolla12:08
*** dave-mccowan has joined #openstack-kolla12:08
*** egonzalez has quit IRC12:10
*** egonzalez has joined #openstack-kolla12:11
*** egonzalez_afk has joined #openstack-kolla12:14
*** gkadam has quit IRC12:14
*** yangyapeng has quit IRC12:14
*** egonzalez has quit IRC12:14
*** yangyapeng has joined #openstack-kolla12:30
*** olivierbourdon38 has joined #openstack-kolla12:34
*** yangyapeng has quit IRC12:35
*** egonzalez has joined #openstack-kolla12:36
*** egonzalez_afk has quit IRC12:37
*** hw_wutianwei has joined #openstack-kolla12:41
*** hamza21 has joined #openstack-kolla12:45
*** yangyapeng has joined #openstack-kolla12:47
*** pengdake_ has joined #openstack-kolla13:03
openstackgerritJeffrey Zhang proposed openstack/kolla master: Seem there are some wrong in infra ubuntu repo  https://review.openstack.org/54338713:05
*** pengdake_ has quit IRC13:06
*** mdnadeem has quit IRC13:09
*** k_mouza has quit IRC13:10
*** dciabrin has quit IRC13:16
*** dciabrin has joined #openstack-kolla13:17
*** skramaja has quit IRC13:22
*** Ashu has joined #openstack-kolla13:35
*** ktibi_ has joined #openstack-kolla13:35
AshuHello13:35
AshuI am facing issue while installation of ovs dpdk in kolla ansible13:36
*** mdnadeem has joined #openstack-kolla13:36
AshuAfter deployment neutron openvswitch agent is in restart in state13:36
*** ktibi has quit IRC13:38
*** gfidente has quit IRC13:45
*** Ashu has quit IRC13:45
*** ktibi_ has quit IRC13:46
*** serlex has joined #openstack-kolla13:48
*** gfidente has joined #openstack-kolla13:51
*** gfidente has quit IRC13:51
*** gfidente has joined #openstack-kolla13:51
*** kong has quit IRC13:55
*** hnl has quit IRC13:57
*** zshi has quit IRC13:59
*** goldyfruit has joined #openstack-kolla13:59
*** hachi has joined #openstack-kolla14:06
*** hamza21 has quit IRC14:09
*** zshi has joined #openstack-kolla14:12
*** david-lyle has quit IRC14:38
*** janki has quit IRC14:39
*** jtriley has joined #openstack-kolla14:58
*** mchlumsky has joined #openstack-kolla15:01
*** mnasiadka has quit IRC15:04
*** mnasiadka has joined #openstack-kolla15:08
*** mnasiadka has quit IRC15:13
*** ktibi has joined #openstack-kolla15:16
*** hachi has quit IRC15:17
dtklol, just seen that15:18
dtk3gb logs you say15:18
dtkhas anybody tried using http://fluentbit.io/ instead of full blown fluentd ?15:19
*** AJaeger has joined #openstack-kolla15:22
AJaegerkolla-kubernetes team, your Zuul v3 job is not working - change https://review.openstack.org/540669 fixes it. Could you review, please?15:22
*** mnasiadka has joined #openstack-kolla15:23
openstackgerritKevin Tibi proposed openstack/kolla-ansible master: Fix SSL api for glance and cinder  https://review.openstack.org/54348815:24
*** mnasiadka has quit IRC15:27
*** jbrooks has joined #openstack-kolla15:29
*** cloudnull has quit IRC15:32
*** nanliu_ has quit IRC15:32
*** nanliu_ has joined #openstack-kolla15:32
*** lvdombrkr has quit IRC15:33
AJaegerkfox1111, sdake, could you review  https://review.openstack.org/540669  , please?15:33
*** egonzalez has quit IRC15:35
*** cloudnull has joined #openstack-kolla15:36
*** mnasiadka has joined #openstack-kolla15:38
*** caowei has quit IRC15:42
*** mnasiadka has quit IRC15:42
*** mnasiadka has joined #openstack-kolla15:43
rwellumAJaeger: there's a ton of failures there?15:45
rwellumJeffrey4l: hey - looks like Kolla only has one day assigned at the PTG: https://www.openstack.org/ptg/#tab_schedule ?15:45
*** imcsk8 has joined #openstack-kolla15:45
*** david-lyle has joined #openstack-kolla15:46
AJaegerrwellum: yes. My change does not change that, it's same as before ;(15:49
AJaegerrwellum: It's just making it clear...15:49
*** zhaochao has quit IRC15:50
AJaegerrwellum: same failures here: https://review.openstack.org/#/c/537834/15:50
AJaegera followup change removes the legacy jobs from kolla-kubernetes - and then you can fix and adjust jobs in-tree easily.15:51
AJaegerrwellum: any other questions on that one? Happy to answer...15:51
*** olivierbourdon38 has quit IRC15:53
*** k_mouza has joined #openstack-kolla15:53
rwellumI'll take a look AJaeger - looks like our sanity is in a mess though...15:53
AJaegerrwellum: it is, indeed. And merging a Zuul v3 file with the wrong name does not make it easier ;)15:54
AJaegerrwellum: my change fixes at least the obvious problems and the failures are the same as the legacy ones if I checked correctly15:54
AJaegerrwellum: thanks15:54
rwellumkfox1111: you seen the current state of kolla-k8s?15:57
*** pcaruana has quit IRC16:04
*** JamesBenson has joined #openstack-kolla16:06
*** itlinux has joined #openstack-kolla16:08
*** krtaylor has quit IRC16:10
*** itlinux has quit IRC16:10
*** jtriley has quit IRC16:14
*** k_mouza has quit IRC16:18
*** Teck7 has joined #openstack-kolla16:19
ktibineutron does not use WSGI for API in kolla ?16:21
*** itlinux has joined #openstack-kolla16:22
*** rfxn has quit IRC16:23
*** itlinux has quit IRC16:23
*** dardelean has quit IRC16:30
*** dardelean has joined #openstack-kolla16:31
*** itlinux has joined #openstack-kolla16:34
openstackgerritKevin Tibi proposed openstack/kolla-ansible master: [WIP] Fix SSL api for multiple services  https://review.openstack.org/54348816:35
*** dardelean has quit IRC16:35
*** jtriley has joined #openstack-kolla16:40
openstackgerritKevin Tibi proposed openstack/kolla-ansible master: Fix SSL api for multiple services  https://review.openstack.org/54348816:45
*** olivierbourdon38 has joined #openstack-kolla16:49
*** mgoddard_ has joined #openstack-kolla17:00
SamYaplektibi: neutron wsgi doesnt work by itself17:00
SamYapleyou still need neutron-server because neutron-rpc-server is busted17:00
ktibiSamYaple, ok so we have a problem because without wsgi, neutron behind haproxy with SSL no works :/17:01
ktibiSamYaple, https://review.openstack.org/#/c/384294/17:02
*** mdnadeem has quit IRC17:02
SamYaplektibi: you *can* run neutron behing wsgi, but you must still also run neutron-server17:02
ktibiyes of course, but I want to deploy with kolla, so need to change the dockerfile17:03
SamYaplewhat i do at my house is run neutron-api, then run neutron-server bound to 127.0.0.1:1232117:03
SamYapleesh no. hopefully not17:03
SamYapleyou should be able to get this done in kolla-ansible alone17:03
ktibineutron-api ?17:03
SamYapleneutron-server is actually two things, neutron-api and neutron-rpc-server17:03
SamYaplein Pike it was officially split17:04
ktibiok but not split in kolla ?17:04
SamYaplebut neutron-rpc-server is borked currently, so youll need to run neutron-server and neutron-api17:04
ktibiSamYaple, I don't know how make that :/17:06
SamYapleits literally running 'neutron-api' instead of 'neutron-server'17:08
ktibiwith which image ?17:08
sdakeAJaeger sadly I have not been keeping up with the state of affairs on either kolla-kubernetes or zuulv3 porting17:12
sdakeAJaeger howeveer, if you are certain that patch needs to merge for the community to make forward progress on the zuulv3 port, we can merge that work17:12
AJaegersdake: yes, that change is needed to use the file and fix it17:13
*** mdnadeem has joined #openstack-kolla17:15
AJaegersdake: and it allows you to change the setup on your own without me reviewing project-config ;)17:19
*** rhallisey has quit IRC17:21
sdakeAJaeger nice :)17:22
sdakeAJaeger fwiw I did look over the patch17:22
sdakeand pciked up on that :)17:22
sdakeshoudl make zuul more scalable form a human pov17:23
AJaegersdake: yes, if no obvious errors are done like using a file that is not used ;)17:23
sdakeAJaeger - notied zuul got its own domain name - YAY :)17:27
*** b_bezak has quit IRC17:29
*** b_bezak has joined #openstack-kolla17:29
*** serlex has quit IRC17:30
*** b_bezak has quit IRC17:34
*** mdnadeem has quit IRC17:35
AJaegeryep17:36
AJaegerand it's own channel - #zuul :)17:36
*** hw_wutianwei_ has quit IRC17:39
*** jmccarthy has quit IRC17:43
openstackgerritKevin Tibi proposed openstack/kolla-ansible master: Fix SSL api for multiple services  https://review.openstack.org/54348817:47
openstackgerritKevin Tibi proposed openstack/kolla-ansible master: Fix SSL api for multiple services  https://review.openstack.org/54348817:55
*** david-lyle has quit IRC17:55
*** mgoddard_ has quit IRC17:58
*** hamza21 has joined #openstack-kolla18:00
*** dklyle has joined #openstack-kolla18:07
*** harlowja has joined #openstack-kolla18:14
openstackgerritKevin Tibi proposed openstack/kolla-ansible master: Fix SSL api for multiple services  https://review.openstack.org/54348818:22
*** gfidente is now known as gfidente|afk18:23
jmcevoyinc0  When running an upgrade from 3.0.3 to 4.0.3 the openvswitchd and openvswitch_db containers started.  I have native openvswitch on the baremetal... How do I disable the openvswitch containers... In 3.0.3 I patched the first 75 lines in start.yml... Not part of 4.0.418:23
*** hamza21 has quit IRC18:25
*** dardelean has joined #openstack-kolla18:25
*** hamza21 has joined #openstack-kolla18:26
*** mnasiadka has quit IRC18:28
*** lpetrut has joined #openstack-kolla18:28
*** lpetrut has quit IRC18:29
SamYaplejmcevoy: if there is no toggle switch,then youll needto bug/patch it18:29
SamYapleexternal_openvswitch is a thing in later versions i believe i saw that in passing18:29
*** dklyle has quit IRC18:30
*** dardelean has quit IRC18:30
jmcevoyThanks SamYaple18:30
*** jbrooks has quit IRC18:32
*** rhallisey has joined #openstack-kolla18:35
*** mnasiadka has joined #openstack-kolla18:37
*** jbrooks has joined #openstack-kolla18:38
*** lpetrut has joined #openstack-kolla18:40
*** pradk has joined #openstack-kolla18:42
*** mnasiadka has quit IRC18:44
*** signed8bit has joined #openstack-kolla18:47
*** itlinux has quit IRC18:49
*** itlinux has joined #openstack-kolla18:51
*** itlinux has quit IRC18:53
*** unicell has joined #openstack-kolla18:53
*** mnasiadka has joined #openstack-kolla18:53
*** david-lyle has joined #openstack-kolla18:54
*** itlinux has joined #openstack-kolla18:55
*** robbbe has joined #openstack-kolla18:55
*** mnasiadka has quit IRC18:58
*** signed8bit has quit IRC19:00
AJaegersdake: who else reviews kolla-kubernetes and can help with https://review.openstack.org/#/c/540669/ , please ? I like to do the followup cleanups for that...19:07
*** mnasiadka has joined #openstack-kolla19:07
*** mnasiadka has quit IRC19:12
*** sambetts is now known as sambetts|afk19:13
*** rwsu has quit IRC19:13
*** rwsu has joined #openstack-kolla19:13
*** signed8bit has joined #openstack-kolla19:16
*** hamza21 has quit IRC19:20
inc0AJaeger: done19:22
*** mnasiadka has joined #openstack-kolla19:23
AJaegerthanks, inc019:24
*** hamza21 has joined #openstack-kolla19:24
kfox1111morning.19:24
*** mnasiadka has quit IRC19:28
*** gfidente|afk has quit IRC19:33
rwellumMorning kfox111119:33
rwellumAny idea what's going on with our sanities?19:33
rwellumhttp://logs.openstack.org/69/540669/7/check/legacy-kolla-kubernetes-deploy-ubuntu-source-4-microchart-ansible/083af36/job-output.txt.gz#_2018-02-04_19_47_06_31216719:34
*** mnasiadka has joined #openstack-kolla19:39
*** mnasiadka has quit IRC19:44
*** pramodrj07 has joined #openstack-kolla19:49
kfox1111rwellum: looks like something changed so that fips are now broken.19:53
kfox1111so,  gotta figure out why.19:53
SamYapleinc0: sup brother19:53
*** mnasiadka has joined #openstack-kolla19:53
kfox1111rwellum: so, the command: openstack server add floating ip test 172.18.0.66  failed.19:55
rwellumInteresting19:56
*** mnasiadka has quit IRC19:59
kfox1111so, then look in the logs directory for things that may be related.19:59
*** JamesBenson has quit IRC19:59
openstackgerritMerged openstack/kolla-kubernetes master: Really use imported Zuul jobs  https://review.openstack.org/54066920:01
*** JamesBenson has joined #openstack-kolla20:01
*** JamesBen_ has joined #openstack-kolla20:03
kfox1111so... seems like more then one thing changed.20:05
kfox1111a lot of the logs are coming up empty too.20:05
kfox1111like, look at: http://logs.openstack.org/69/540669/7/check/kolla-kubernetes-deploy-centos-binary-2-external-ovs/a4347ba/logs/virsh_list.txt.gz20:05
kfox1111its empty.20:05
kfox1111but, http://logs.openstack.org/69/540669/7/check/kolla-kubernetes-deploy-centos-binary-2-external-ovs/a4347ba/logs/libvirt-vm-logs.txt.gz seems to imply there is a vm launched ok.20:06
*** JamesBenson has quit IRC20:06
kfox1111so fixing up the logging would be step 1.20:06
kfox1111something may have changed in zuul3 in how it runs things. :/20:06
kfox1111http://logs.openstack.org/69/540669/7/check/kolla-kubernetes-deploy-centos-binary-2-external-ovs/a4347ba/logs/openstack_server_list.txt.gz is empty too though.20:07
*** mnasiadka has joined #openstack-kolla20:08
*** JamesBen_ has quit IRC20:08
AJaegerkfox1111: there were a few changes but these legacy jobs should have no changes20:08
AJaegerkfox1111: but best to ask in #openstack-infra if you think Zuul config/set up is the problem20:09
kfox1111not sure yet. it just went from working to non working.20:11
kfox1111not much has changed in a while.20:11
kfox1111so, base os, k8s repo, other repo, zuul, all could be issues.20:12
kfox1111sudo virsh list > $WORKSPACE/logs/virsh_list.txt failing is really weird though...20:13
*** mnasiadka has quit IRC20:13
SamYaplekfox1111: does it just hang until the job timesout?20:13
kfox1111I don't think so.20:13
SamYapleah ignore then20:14
kfox1111ok. lets see... anything common between whats logging and whats not...20:14
SamYaplei had a similiar issue where a redirect like that caused the job to hang suddenly (past 2 weeks).20:15
SamYaplei think i was doign `journalctl -xb -u docker > docker_daemon`20:15
SamYapleand that was hanging, couldnt figure it out, but some of my other redirects i had to change too20:15
kfox11112018-02-04 19:56:09.351 22 INFO neutron.wsgi [req-e1076eaf-568b-4023-b559-04863efa37bc a3ba4a199f284cc983faefec2ba1ef38 e542775a4ea9451bbc07f453abebae80 - - -] 166.78.99.83,127.0.0.1 - - [04/Feb/2018 19:56:09] "POST /v2.0/floatingips HTTP/1.1" 201 540 0.50212820:17
kfox1111looks like the request made it...20:17
*** k_mouza has joined #openstack-kolla20:17
*** unicell has quit IRC20:17
*** k_mouza_ has joined #openstack-kolla20:22
*** k_mouza has quit IRC20:22
*** mnasiadka has joined #openstack-kolla20:23
*** hamza21 has quit IRC20:26
kfox1111about when it failed this happened:20:27
kfox11112018-02-04 19:56:12.141 20 DEBUG nova.compute.api [req-c9fc2d53-7588-4e50-adc6-f51f37e72878 a3ba4a199f284cc983faefec2ba1ef38 e542775a4ea9451bbc07f453abebae80 - - -] Failed to fetch instance by id test get /usr/lib/python2.7/site-packages/nova/compute/api.py:201820:27
kfox11112018-02-04 19:56:12.142 20 INFO nova.api.openstack.wsgi [req-c9fc2d53-7588-4e50-adc6-f51f37e72878 a3ba4a199f284cc983faefec2ba1ef38 e542775a4ea9451bbc07f453abebae80 - - -] HTTP exception thrown: Instance test could not be found.20:27
SamYaplekfox1111: 'test' instance in a diffenerent project than your sourced credentials?20:28
*** kong has joined #openstack-kolla20:28
kfox1111was created all at once. shouldn't have changed.20:28
kfox1111likely there is now a problem with the vm I think.20:28
*** mnasiadka has quit IRC20:29
*** hw_wutianwei has quit IRC20:31
*** hw_wutianwei has joined #openstack-kolla20:32
*** robbbe has quit IRC20:33
*** robbbe has joined #openstack-kolla20:34
*** robbbe has quit IRC20:34
*** unicell has joined #openstack-kolla20:34
*** lpetrut has quit IRC20:38
*** mnasiadka has joined #openstack-kolla20:38
*** robbbe has joined #openstack-kolla20:40
*** robbbe has quit IRC20:40
*** mnasiadka has quit IRC20:43
*** robbbe has joined #openstack-kolla20:43
*** robbbe has quit IRC20:43
*** livelace-link has joined #openstack-kolla20:44
*** robbbe has joined #openstack-kolla20:46
*** robbbe has quit IRC20:47
*** robbbe has joined #openstack-kolla20:47
*** robbbe has joined #openstack-kolla20:50
*** robbbe has quit IRC20:50
*** itlinux has quit IRC20:51
*** robbbe has joined #openstack-kolla20:52
*** robbbe has quit IRC20:52
*** k_mouza_ has quit IRC20:52
*** mnasiadka has joined #openstack-kolla20:53
*** robbbe has joined #openstack-kolla20:55
*** robbbe has joined #openstack-kolla20:56
*** robbbe has quit IRC20:56
kfox1111its like something gets really messed up after the fip is added.20:57
kfox1111http://logs.openstack.org/69/540669/7/check/kolla-kubernetes-deploy-centos-binary-2-external-ovs/a4347ba/logs/openstack-catalog-after-bootstrap.json works,20:57
kfox1111http://logs.openstack.org/69/540669/7/check/kolla-kubernetes-deploy-centos-binary-2-external-ovs/a4347ba/logs/openstack-catalog.txt.gz doesnt20:57
kfox1111and they are 9 seconds apart.20:57
*** k_mouza has joined #openstack-kolla20:58
*** mnasiadka has quit IRC20:58
kfox1111oh... here we go....20:59
kfox1111tests/bin/gate_capture_logs.sh: line 101: openstack: command not found20:59
kfox1111so, that would explain it if that isn't installed anymore.21:01
*** ChanServ has quit IRC21:02
*** k_mouza has quit IRC21:02
*** mnasiadka has joined #openstack-kolla21:06
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: Fix the gate.  https://review.openstack.org/54361721:07
*** ChanServ has joined #openstack-kolla21:11
*** barjavel.freenode.net sets mode: +o ChanServ21:11
SamYapleheh21:12
*** mnasiadka has quit IRC21:12
*** jmcevoy has quit IRC21:14
*** dardelean has joined #openstack-kolla21:15
*** mnasiadka has joined #openstack-kolla21:23
*** jgriffith has quit IRC21:26
*** rfxn has joined #openstack-kolla21:26
*** mnasiadka has quit IRC21:28
*** Teck7 has quit IRC21:31
openstackgerritMartin Mágr proposed openstack/kolla master: Add socat to iscsid image  https://review.openstack.org/54362421:31
*** Teck7 has joined #openstack-kolla21:37
*** mnasiadka has joined #openstack-kolla21:38
*** rfxn has quit IRC21:40
*** mnasiadka has quit IRC21:43
*** k_mouza has joined #openstack-kolla21:47
*** k_mouza has quit IRC21:51
*** k_mouza has joined #openstack-kolla21:51
*** mnasiadka has joined #openstack-kolla21:53
*** mnasiadka has quit IRC21:58
dtkHello everybody22:05
dtkthere is an infra problem which causes zuul to fail when building the kolla images22:05
dtkhttp://logs.openstack.org/81/542481/6/check/kolla-build-ubuntu-binary/0c6763a/logs/build/nova-libvirt.txt.gz22:06
dtkhttps://review.openstack.org/#/c/543387/22:06
dtkJeffrey4l made this change in order to fix that22:06
dtkcan you please have a look ?22:07
*** mnasiadka has joined #openstack-kolla22:08
dtkthis is the actual error:22:08
dtklibvirt-daemon-system : Depends: policykit-1 but it is not going to be installed22:08
*** threestrands has joined #openstack-kolla22:12
*** mnasiadka has quit IRC22:13
*** charliekang has quit IRC22:13
*** jtriley has quit IRC22:14
*** rhallisey has quit IRC22:19
*** mnasiadka has joined #openstack-kolla22:23
*** mnasiadka has quit IRC22:28
*** ktibi has quit IRC22:29
*** masber has quit IRC22:29
*** mnasiadka has joined #openstack-kolla22:38
*** mnasiadka has quit IRC22:42
*** mnasiadka has joined #openstack-kolla22:53
*** mnasiadka has quit IRC22:57
*** signed8b_ has joined #openstack-kolla23:01
*** signed8bit has quit IRC23:04
*** ramishra has quit IRC23:05
*** pradk has quit IRC23:07
*** mnasiadka has joined #openstack-kolla23:08
*** mnasiadka has quit IRC23:13
*** mnasiadka has joined #openstack-kolla23:24
*** mnasiadka has quit IRC23:28
*** mnasiadka has joined #openstack-kolla23:38
*** signed8b_ is now known as signed8bit_Zzz23:39
*** mnasiadka has quit IRC23:43
*** mnasiadka has joined #openstack-kolla23:53
*** bmace_ has quit IRC23:56
*** mnasiadka has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!