| *** mlavalle has quit IRC | 00:02 | |
| *** Ghanshyam has joined #openstack-qa | 00:03 | |
| *** Ghanshyam has quit IRC | 00:04 | |
| *** GMann has joined #openstack-qa | 00:05 | |
| *** mmaglana has joined #openstack-qa | 00:06 | |
| *** sweston has joined #openstack-qa | 00:23 | |
| *** yrabl has quit IRC | 00:24 | |
| *** yrabl has joined #openstack-qa | 00:25 | |
| *** cadenzajon_ has joined #openstack-qa | 00:28 | |
| *** nati_ueno has quit IRC | 00:30 | |
| *** mmaglana has quit IRC | 00:31 | |
| *** cadenzajon has quit IRC | 00:32 | |
| openstackgerrit | John Bresnahan proposed a change to openstack-dev/devstack: read returns failure when the docker pid file has no newline https://review.openstack.org/78051 | 00:37 |
|---|---|---|
| *** atiwari has quit IRC | 00:37 | |
| openstackgerrit | Aaron Rosen proposed a change to openstack-dev/devstack: Running neutron callback with required patches https://review.openstack.org/78052 | 00:38 |
| openstackgerrit | Aaron Rosen proposed a change to openstack-dev/devstack: Configuration needed for neutron nova callback https://review.openstack.org/78044 | 00:38 |
| *** zhikunliu has joined #openstack-qa | 00:40 | |
| *** nati_ueno has joined #openstack-qa | 00:41 | |
| *** bill_az has quit IRC | 00:45 | |
| openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: cleanup resources in setUpClass if exception raised https://review.openstack.org/76862 | 01:05 |
| *** shwetaap1 has quit IRC | 01:08 | |
| *** sthaha has joined #openstack-qa | 01:14 | |
| *** sthaha has quit IRC | 01:14 | |
| *** sthaha has joined #openstack-qa | 01:14 | |
| openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: add token get tests https://review.openstack.org/76459 | 01:19 |
| *** sthaha has quit IRC | 01:22 | |
| *** sthaha has joined #openstack-qa | 01:22 | |
| *** mmaglana has joined #openstack-qa | 01:26 | |
| openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: V2 API Test to get the VNC console of a Server https://review.openstack.org/78060 | 01:28 |
| *** mmaglana has quit IRC | 01:29 | |
| *** rwsu has quit IRC | 01:29 | |
| *** harlowja has quit IRC | 01:31 | |
| *** markmcclain has quit IRC | 01:32 | |
| openstackgerrit | wanglianmin proposed a change to openstack/tempest: Add some authorization tests for network https://review.openstack.org/77128 | 01:34 |
| openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: cleanup resources in setUpClass if exception raised https://review.openstack.org/76862 | 01:36 |
| *** vkozhukalov has joined #openstack-qa | 01:36 | |
| *** mrodden has joined #openstack-qa | 01:38 | |
| *** vkozhukalov has quit IRC | 01:42 | |
| *** jufeng has joined #openstack-qa | 01:48 | |
| *** nosnos has joined #openstack-qa | 01:56 | |
| *** rfolco has joined #openstack-qa | 02:02 | |
| *** rfolco has quit IRC | 02:12 | |
| *** mwagner_lap has joined #openstack-qa | 02:16 | |
| *** harlowja has joined #openstack-qa | 02:17 | |
| *** nati_ueno has quit IRC | 02:43 | |
| *** yfujioka has joined #openstack-qa | 02:46 | |
| SlickNik | Tempest reviewers: Can you guys please take a look at https://review.openstack.org/#/c/69501/19 when you get a chance? Thanks much! | 02:48 |
| *** coolsvap1 has quit IRC | 02:55 | |
| *** sweston has quit IRC | 03:09 | |
| *** harlowja is now known as harlowja_away | 03:13 | |
| openstackgerrit | Aaron Rosen proposed a change to openstack-dev/devstack: Running neutron callback with required patches https://review.openstack.org/78052 | 03:13 |
| openstackgerrit | A change was merged to openstack/tempest: image(s) schema image metadata API test https://review.openstack.org/77065 | 03:19 |
| *** weshay has quit IRC | 03:27 | |
| *** sweston has joined #openstack-qa | 04:00 | |
| *** harlowja_away has quit IRC | 04:17 | |
| openstackgerrit | A change was merged to openstack/tempest: Stop running CONF getattr during import https://review.openstack.org/77358 | 04:21 |
| openstackgerrit | Ronak Shah proposed a change to openstack-dev/devstack: Supporting Nuage Networks' Plugin through devstack https://review.openstack.org/78042 | 04:36 |
| openstackgerrit | Mh Raies proposed a change to openstack/tempest: Correction in order of parameters of assertEqual https://review.openstack.org/77861 | 04:54 |
| openstackgerrit | Mh Raies proposed a change to openstack/tempest: Volume backup details API test https://review.openstack.org/77134 | 04:56 |
| *** yfried has quit IRC | 04:58 | |
| openstackgerrit | xu-haiwei proposed a change to openstack/tempest: Prepare for enabling H302 rule(services/identity) https://review.openstack.org/77857 | 05:08 |
| openstackgerrit | Mh Raies proposed a change to openstack/tempest: Volume backup details API test https://review.openstack.org/77134 | 05:19 |
| *** mmaglana has joined #openstack-qa | 05:21 | |
| openstackgerrit | Mh Raies proposed a change to openstack/tempest: Correction in order of parameters of assertEqual https://review.openstack.org/77861 | 05:27 |
| *** chandankumar_ has quit IRC | 05:28 | |
| *** mmaglana has quit IRC | 05:34 | |
| *** mmaglana has joined #openstack-qa | 05:35 | |
| *** markmcclain has joined #openstack-qa | 05:37 | |
| *** mmaglana has quit IRC | 05:39 | |
| *** markmcclain1 has joined #openstack-qa | 05:39 | |
| *** markmcclain has quit IRC | 05:41 | |
| *** amotoki has joined #openstack-qa | 05:46 | |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Verify server attributes which admin can get Nova APIs https://review.openstack.org/77517 | 05:54 |
| *** ivanzhu has joined #openstack-qa | 06:06 | |
| *** Madan has joined #openstack-qa | 06:08 | |
| openstackgerrit | Yuiko Takada proposed a change to openstack/tempest: Add V2 Nova API os-agents tests https://review.openstack.org/78111 | 06:18 |
| openstackgerrit | Sukhdev Kapur proposed a change to openstack/tempest: Networks,Ports: delete with subnet, port with no IP https://review.openstack.org/66921 | 06:24 |
| raies | some there to help on nova | 06:31 |
| raies | ?? | 06:31 |
| SlickNik | raies: did you have a question? | 06:33 |
| raies | SlickNik: hi | 06:33 |
| raies | yes | 06:33 |
| raies | SlickNik: I booted an instance using a vlan | 06:34 |
| raies | when this instance was running then I take a snapshot | 06:34 |
| raies | using command nova image-create 344220ec-cc82-49af-aeb8-78a59d6dad34 cloud-pipe-image | 06:34 |
| raies | now when I check nova image-list | 06:35 |
| raies | created snapshot does not exists in the list | 06:35 |
| raies | this is the basic problem | 06:35 |
| raies | SlickNik: you can check status after nova image create here http://www.fpaste.org/82445/13940013/ | 06:36 |
| SlickNik | raies: probably a question for #openstack, since it's more ops related than dev. | 06:37 |
| raies | SlickNik: ok | 06:37 |
| raies | SlickNik: Thanks | 06:37 |
| SlickNik | raies: The nova-api.log is probably worth a look though. | 06:38 |
| SlickNik | raies: I'm guessing your image create failed due to some reason. | 06:39 |
| *** yrabl has quit IRC | 06:43 | |
| *** yrabl has joined #openstack-qa | 06:43 | |
| *** vkozhukalov has joined #openstack-qa | 06:47 | |
| GMann | @raies - use the snapshot option of Horizon if you are finding any issues in CLIs. | 06:52 |
| GMann | and check the correct image type also whether it is backup, snapshot, or image etc | 06:53 |
| raies | GMann: ok | 06:54 |
| *** vkozhukalov has quit IRC | 07:00 | |
| *** saju_m has joined #openstack-qa | 07:02 | |
| raies | GMann: same issue I should try another way | 07:03 |
| GMann | try with Horizon | 07:04 |
| raies | GMann: I tried with horizon also but same issue | 07:05 |
| raies | GMann: and no logs shows any error | 07:05 |
| *** afazekas has joined #openstack-qa | 07:09 | |
| raies | GMann: Now I am downloading qcow2 centos image, now I will try to make snapshot using this one | 07:11 |
| GMann | try with some other image to confirm your enviornement. | 07:11 |
| GMann | yes | 07:11 |
| raies | afazekas: needs help on this http://www.fpaste.org/82453/13940035/ | 07:13 |
| afazekas | raies: did you used the same user ? did you do it as admin or not admin ? | 07:15 |
| *** ivanzhu has quit IRC | 07:17 | |
| raies | non admin | 07:18 |
| raies | afazekas: ^^ | 07:18 |
| raies | afazekas: I tried it using admin also but same problem | 07:19 |
| SlickNik | raies: Any errors in nova-compute.log, or glance-api.log? | 07:22 |
| *** afazekas is now known as afazekas|food | 07:23 | |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Verify server attributes which admin can get Nova APIs https://review.openstack.org/77517 | 07:23 |
| raies | SlickNik: no error | 07:28 |
| *** mkoderer has joined #openstack-qa | 07:28 | |
| *** afazekas|food is now known as afazekas | 07:28 | |
| *** nmagnezi has joined #openstack-qa | 07:28 | |
| *** nmagnezi has joined #openstack-qa | 07:29 | |
| afazekas | raies: is the instance status changes to image creation ? | 07:29 |
| raies | afazekas: instance status is troughout Active | 07:31 |
| raies | afazekas: task state changes as ==> "-" --> "image_snapshot" --> "-" | 07:32 |
| raies | afazekas: sorry task state is as ===>> "-" --> "image_snapshot" --> "image_pending_upload" ---> "-" | 07:33 |
| raies | nova list shows my machine instance task state "-", while in normal case I think of it as ""None " right ?? | 07:35 |
| raies | afazekas: ^^ | 07:35 |
| *** yfried has joined #openstack-qa | 07:37 | |
| GMann | raies- it takes time for snapshots, check on Horizon whether in snapshots it is showing? | 07:38 |
| afazekas | raies: do you see the image with the glance image-list ? | 07:39 |
| openstackgerrit | Yuiko Takada proposed a change to openstack/tempest: Enable H302 check (api/identity/admin) https://review.openstack.org/78125 | 07:39 |
| raies | afazekas: yes I did http://www.fpaste.org/82459/13940052/ | 07:41 |
| afazekas | raies: can you check the glance log ? | 07:42 |
| afazekas | Do you have enough freee space for the image ? | 07:42 |
| afazekas | the glance kills the image on I/O error | 07:42 |
| *** nmagnezi has quit IRC | 07:44 | |
| raies | afazekas: free space http://www.fpaste.org/82460/39400548/ | 07:44 |
| afazekas | So you have a glance with filesystem backend ? | 07:46 |
| yfried | salv-orlando: ping | 07:46 |
| openstackgerrit | Yair Fried proposed a change to openstack/tempest: Adds Cross Host Scenario https://review.openstack.org/77816 | 07:46 |
| *** nati_ueno has joined #openstack-qa | 07:47 | |
| raies | afazekas: using devstack development environment | 07:47 |
| afazekas | raies: is swift enabled ? | 07:48 |
| *** ivanzhu has joined #openstack-qa | 07:49 | |
| raies | afazekas: no | 07:50 |
| raies | afazekas: going lunch will discuss later | 07:50 |
| afazekas | raies: can you snapshot a cirros instance ? | 07:50 |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Verify AZ attributes through Nova "get az" API https://review.openstack.org/77807 | 07:50 |
| afazekas | raies: maybe it is related to the image size | 07:50 |
| *** evgenyf has joined #openstack-qa | 07:52 | |
| yfried | salv-orlando: ping | 07:54 |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Verify AZ attributes through Nova "get az" API https://review.openstack.org/77807 | 07:55 |
| *** luqas has joined #openstack-qa | 08:07 | |
| *** sweston has quit IRC | 08:11 | |
| *** mwagner_lap has quit IRC | 08:11 | |
| *** nosnos has quit IRC | 08:11 | |
| *** zhikunliu has quit IRC | 08:11 | |
| *** jhenner has quit IRC | 08:11 | |
| *** openstackgerrit has quit IRC | 08:11 | |
| *** hemna_ has quit IRC | 08:11 | |
| *** bdperkin has quit IRC | 08:11 | |
| *** maurosr has quit IRC | 08:11 | |
| *** ilyashakhat has quit IRC | 08:11 | |
| *** ewindisch has quit IRC | 08:11 | |
| *** evgenyf has quit IRC | 08:11 | |
| *** ivanzhu has quit IRC | 08:11 | |
| *** afazekas has quit IRC | 08:11 | |
| *** saju_m has quit IRC | 08:11 | |
| *** yrabl has quit IRC | 08:11 | |
| *** cadenzajon_ has quit IRC | 08:11 | |
| *** clarkb has quit IRC | 08:11 | |
| *** eezhova has quit IRC | 08:11 | |
| *** yamahata_ has quit IRC | 08:11 | |
| *** HenryG has quit IRC | 08:11 | |
| *** marun has quit IRC | 08:11 | |
| *** KurtMartin has quit IRC | 08:11 | |
| *** mestery has quit IRC | 08:11 | |
| *** yfried has quit IRC | 08:11 | |
| *** jufeng has quit IRC | 08:11 | |
| *** openstackrecheck has quit IRC | 08:11 | |
| *** YorikSar has quit IRC | 08:11 | |
| *** enikanorov_ has quit IRC | 08:11 | |
| *** shortstop has quit IRC | 08:11 | |
| *** locke105 has quit IRC | 08:11 | |
| *** dhellmann_ has quit IRC | 08:11 | |
| *** nati_ueno has quit IRC | 08:11 | |
| *** mrodden has quit IRC | 08:11 | |
| *** sthaha has quit IRC | 08:11 | |
| *** krtaylor has quit IRC | 08:11 | |
| *** esmute has quit IRC | 08:11 | |
| *** smurashov has quit IRC | 08:11 | |
| *** akamyshnikova has quit IRC | 08:11 | |
| *** sileht has quit IRC | 08:11 | |
| *** Anju has quit IRC | 08:11 | |
| *** jamielennox has quit IRC | 08:11 | |
| *** sbadia has quit IRC | 08:11 | |
| *** cyeoh has quit IRC | 08:11 | |
| *** mtreinish has quit IRC | 08:11 | |
| *** sdague has quit IRC | 08:11 | |
| *** markmcclain1 has quit IRC | 08:11 | |
| *** jgrimm has quit IRC | 08:11 | |
| *** annegentle has quit IRC | 08:11 | |
| *** sfineberg has quit IRC | 08:11 | |
| *** dansmith has quit IRC | 08:11 | |
| *** enikanorov has quit IRC | 08:11 | |
| *** jeblair has quit IRC | 08:11 | |
| *** jgriffith has quit IRC | 08:11 | |
| *** amotoki has quit IRC | 08:11 | |
| *** jaypipes has quit IRC | 08:11 | |
| *** salv-orlando has quit IRC | 08:11 | |
| *** sseverson has quit IRC | 08:11 | |
| *** SergeyLukjanov has quit IRC | 08:11 | |
| *** ruhe has quit IRC | 08:11 | |
| *** notmyname has quit IRC | 08:11 | |
| *** pleia2 has quit IRC | 08:11 | |
| *** samalba has quit IRC | 08:11 | |
| *** rahmu has quit IRC | 08:11 | |
| *** plomakin_ has quit IRC | 08:11 | |
| *** dosaboy has quit IRC | 08:11 | |
| *** adarazs_ has quit IRC | 08:11 | |
| *** jogo has quit IRC | 08:11 | |
| *** early has quit IRC | 08:11 | |
| *** lifeless has quit IRC | 08:11 | |
| *** BobBall has quit IRC | 08:11 | |
| *** mordred has quit IRC | 08:11 | |
| *** dtroyer has quit IRC | 08:11 | |
| *** mkoderer has quit IRC | 08:11 | |
| *** boris-42 has quit IRC | 08:11 | |
| *** nsaje_ has quit IRC | 08:11 | |
| *** stevebaker has quit IRC | 08:11 | |
| *** StevenK has quit IRC | 08:11 | |
| *** EmilienM has quit IRC | 08:11 | |
| *** chmouel has quit IRC | 08:11 | |
| *** fungi has quit IRC | 08:11 | |
| *** zigo has quit IRC | 08:11 | |
| *** timello has quit IRC | 08:11 | |
| *** wendar has quit IRC | 08:11 | |
| *** russellb has quit IRC | 08:11 | |
| *** adam_g has quit IRC | 08:11 | |
| *** mikal has quit IRC | 08:11 | |
| *** fbo_away has quit IRC | 08:11 | |
| *** morganfainberg has quit IRC | 08:11 | |
| *** GMann has quit IRC | 08:11 | |
| *** raies has quit IRC | 08:11 | |
| *** IzikPenso has quit IRC | 08:11 | |
| *** ekarlso has quit IRC | 08:11 | |
| *** psedlak has quit IRC | 08:11 | |
| *** bnemec has quit IRC | 08:11 | |
| *** kgriffs_afk has quit IRC | 08:11 | |
| *** anteaya has quit IRC | 08:11 | |
| *** shardy has quit IRC | 08:11 | |
| *** devananda has quit IRC | 08:11 | |
| *** SlickNik has quit IRC | 08:11 | |
| *** jhenner has joined #openstack-qa | 08:24 | |
| *** obondarev has quit IRC | 08:28 | |
| *** sweston has joined #openstack-qa | 08:28 | |
| *** mwagner_lap has joined #openstack-qa | 08:28 | |
| *** nosnos has joined #openstack-qa | 08:28 | |
| *** sweston has quit IRC | 08:29 | |
| *** mwagner_lap has quit IRC | 08:29 | |
| *** nosnos has quit IRC | 08:29 | |
| *** jlibosva has joined #openstack-qa | 08:30 | |
| *** yfried has joined #openstack-qa | 09:01 | |
| *** giulivo has joined #openstack-qa | 09:01 | |
| *** devvesa has joined #openstack-qa | 09:01 | |
| *** openstackgerrit has joined #openstack-qa | 09:01 | |
| *** ivanzhu has joined #openstack-qa | 09:01 | |
| *** mwagner_lap has joined #openstack-qa | 09:01 | |
| *** mkoderer has joined #openstack-qa | 09:01 | |
| *** ewindisch has joined #openstack-qa | 09:01 | |
| *** bdperkin has joined #openstack-qa | 09:01 | |
| *** maurosr has joined #openstack-qa | 09:01 | |
| *** nosnos_ has joined #openstack-qa | 09:01 | |
| *** sweston has joined #openstack-qa | 09:01 | |
| *** ilyashakhat_ has joined #openstack-qa | 09:01 | |
| *** hemna__ has joined #openstack-qa | 09:01 | |
| *** nati_ueno has joined #openstack-qa | 09:01 | |
| *** afazekas has joined #openstack-qa | 09:01 | |
| *** saju_m has joined #openstack-qa | 09:01 | |
| *** yrabl has joined #openstack-qa | 09:01 | |
| *** amotoki has joined #openstack-qa | 09:01 | |
| *** markmcclain1 has joined #openstack-qa | 09:01 | |
| *** jufeng has joined #openstack-qa | 09:01 | |
| *** mrodden has joined #openstack-qa | 09:01 | |
| *** sthaha has joined #openstack-qa | 09:01 | |
| *** cadenzajon_ has joined #openstack-qa | 09:01 | |
| *** GMann has joined #openstack-qa | 09:01 | |
| *** jaypipes has joined #openstack-qa | 09:01 | |
| *** kgriffs_afk has joined #openstack-qa | 09:01 | |
| *** jgrimm has joined #openstack-qa | 09:01 | |
| *** annegentle has joined #openstack-qa | 09:01 | |
| *** krtaylor has joined #openstack-qa | 09:01 | |
| *** ekarlso has joined #openstack-qa | 09:01 | |
| *** salv-orlando has joined #openstack-qa | 09:01 | |
| *** raies has joined #openstack-qa | 09:01 | |
| *** esmute has joined #openstack-qa | 09:01 | |
| *** sfineberg has joined #openstack-qa | 09:01 | |
| *** openstackrecheck has joined #openstack-qa | 09:01 | |
| *** clarkb has joined #openstack-qa | 09:01 | |
| *** eezhova has joined #openstack-qa | 09:01 | |
| *** smurashov has joined #openstack-qa | 09:01 | |
| *** YorikSar has joined #openstack-qa | 09:01 | |
| *** akamyshnikova has joined #openstack-qa | 09:01 | |
| *** enikanorov_ has joined #openstack-qa | 09:01 | |
| *** Anju has joined #openstack-qa | 09:01 | |
| *** yamahata_ has joined #openstack-qa | 09:01 | |
| *** HenryG has joined #openstack-qa | 09:01 | |
| *** sileht has joined #openstack-qa | 09:01 | |
| *** dickson.freenode.net sets mode: +o jaypipes | 09:01 | |
| *** marun has joined #openstack-qa | 09:01 | |
| *** sseverson has joined #openstack-qa | 09:01 | |
| *** KurtMartin has joined #openstack-qa | 09:01 | |
| *** boris-42 has joined #openstack-qa | 09:01 | |
| *** SergeyLukjanov has joined #openstack-qa | 09:01 | |
| *** ruhe has joined #openstack-qa | 09:01 | |
| *** mestery has joined #openstack-qa | 09:01 | |
| *** pleia2 has joined #openstack-qa | 09:01 | |
| *** notmyname has joined #openstack-qa | 09:01 | |
| *** psedlak has joined #openstack-qa | 09:01 | |
| *** nsaje_ has joined #openstack-qa | 09:01 | |
| *** samalba has joined #openstack-qa | 09:01 | |
| *** bnemec has joined #openstack-qa | 09:01 | |
| *** dansmith has joined #openstack-qa | 09:01 | |
| *** shortstop has joined #openstack-qa | 09:01 | |
| *** jeblair has joined #openstack-qa | 09:01 | |
| *** locke105 has joined #openstack-qa | 09:01 | |
| *** BobBall has joined #openstack-qa | 09:01 | |
| *** jamielennox|away has joined #openstack-qa | 09:01 | |
| *** dhellmann_ has joined #openstack-qa | 09:01 | |
| *** sbadia has joined #openstack-qa | 09:01 | |
| *** enikanorov has joined #openstack-qa | 09:01 | |
| *** stevebaker has joined #openstack-qa | 09:01 | |
| *** jgriffith has joined #openstack-qa | 09:01 | |
| *** sdague has joined #openstack-qa | 09:01 | |
| *** mtreinish has joined #openstack-qa | 09:01 | |
| *** cyeoh has joined #openstack-qa | 09:01 | |
| *** rahmu has joined #openstack-qa | 09:01 | |
| *** StevenK has joined #openstack-qa | 09:01 | |
| *** plomakin_ has joined #openstack-qa | 09:01 | |
| *** dosaboy has joined #openstack-qa | 09:01 | |
| *** EmilienM has joined #openstack-qa | 09:01 | |
| *** adarazs_ has joined #openstack-qa | 09:01 | |
| *** jogo has joined #openstack-qa | 09:01 | |
| *** anteaya has joined #openstack-qa | 09:01 | |
| *** early has joined #openstack-qa | 09:01 | |
| *** lifeless has joined #openstack-qa | 09:01 | |
| *** mordred has joined #openstack-qa | 09:01 | |
| *** dtroyer has joined #openstack-qa | 09:01 | |
| *** chmouel has joined #openstack-qa | 09:01 | |
| *** fungi has joined #openstack-qa | 09:01 | |
| *** zigo has joined #openstack-qa | 09:01 | |
| *** timello has joined #openstack-qa | 09:01 | |
| *** wendar has joined #openstack-qa | 09:01 | |
| *** russellb has joined #openstack-qa | 09:01 | |
| *** adam_g has joined #openstack-qa | 09:01 | |
| *** mikal has joined #openstack-qa | 09:01 | |
| *** morganfainberg has joined #openstack-qa | 09:01 | |
| *** shardy has joined #openstack-qa | 09:01 | |
| *** fbo_away has joined #openstack-qa | 09:01 | |
| *** devananda has joined #openstack-qa | 09:01 | |
| *** SlickNik has joined #openstack-qa | 09:01 | |
| *** jordanP has joined #openstack-qa | 09:02 | |
| *** jhenner has quit IRC | 09:02 | |
| *** jhenner has joined #openstack-qa | 09:02 | |
| *** jlibosva has quit IRC | 09:02 | |
| *** jlibosva has joined #openstack-qa | 09:02 | |
| *** kgriffs_afk is now known as kgriffs | 09:02 | |
| *** jufeng has quit IRC | 09:02 | |
| *** tkammer has joined #openstack-qa | 09:03 | |
| *** fbo_away is now known as fbo | 09:05 | |
| *** jpich has joined #openstack-qa | 09:05 | |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Add a common class for Nova v2/v3 API tests https://review.openstack.org/78137 | 09:05 |
| openstackgerrit | xu-haiwei proposed a change to openstack/tempest: Prepare for enabling H302 rule(services/compute/xml) https://review.openstack.org/78139 | 09:06 |
| *** 16WAAZIB1 has joined #openstack-qa | 09:14 | |
| *** rossella_s has joined #openstack-qa | 09:14 | |
| *** 16WAAZIB1 has quit IRC | 09:14 | |
| *** rossella_s has quit IRC | 09:15 | |
| *** rossella_s has joined #openstack-qa | 09:15 | |
| *** yassine has joined #openstack-qa | 09:16 | |
| *** rossella_s has quit IRC | 09:18 | |
| *** saju_m has quit IRC | 09:19 | |
| *** rossella-s has joined #openstack-qa | 09:19 | |
| *** andreaf has joined #openstack-qa | 09:20 | |
| *** jufeng has joined #openstack-qa | 09:22 | |
| *** luqas has quit IRC | 09:22 | |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Verify AZ attributes through Nova "get az" API https://review.openstack.org/77807 | 09:24 |
| SlickNik | afazekas / other Tempest reviewers: Fixed https://review.openstack.org/#/c/69501/, and it passed jenkins check (and experimental). Please review when you get a chance. Thanks! | 09:25 |
| *** psharma has joined #openstack-qa | 09:25 | |
| *** devvesa has quit IRC | 09:26 | |
| raies | giulivo: https://review.openstack.org/#/c/77861/ and https://review.openstack.org/#/c/77134/ | 09:26 |
| openstackgerrit | anju Tiwari proposed a change to openstack/tempest: Removed teardown method from image test https://review.openstack.org/76083 | 09:27 |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Add a common class for Nova v2/v3 API tests https://review.openstack.org/78137 | 09:27 |
| *** luqas has joined #openstack-qa | 09:30 | |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Verify server attributes which admin can get Nova APIs https://review.openstack.org/77517 | 09:33 |
| openstackgerrit | Eiichi Aikawa proposed a change to openstack/tempest: Prepare for enabling H302 rule(data_processing, v3, volumes) https://review.openstack.org/78145 | 09:34 |
| *** sthaha has quit IRC | 09:34 | |
| *** saju_m has joined #openstack-qa | 09:35 | |
| *** gszasz has joined #openstack-qa | 09:37 | |
| giulivo | raies, on https://review.openstack.org/#/c/77861/ sorry to have misguided you but apparently testtools inverts the order of the args compared to unittest :( | 09:37 |
| raies | giulivo: its ok | 09:37 |
| *** safchain has joined #openstack-qa | 09:38 | |
| *** markmcclain1 has quit IRC | 09:43 | |
| *** psharma has quit IRC | 09:47 | |
| *** rossella-s has quit IRC | 09:48 | |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Verify server attributes which admin can get through Nova APIs https://review.openstack.org/77517 | 09:50 |
| *** rossella-s has joined #openstack-qa | 09:51 | |
| *** kgriffs is now known as kgriffs_afk | 10:04 | |
| openstackgerrit | Masayuki Igawa proposed a change to openstack/tempest: Add a test for booting instances at the specified AZs or hosts https://review.openstack.org/66882 | 10:04 |
| openstackgerrit | Ghanshyam Mann proposed a change to openstack/tempest: xV2 API Test to get the VNC console of a Server https://review.openstack.org/78060 | 10:09 |
| *** rossella_s has joined #openstack-qa | 10:09 | |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Verify service attributes through Nova "get services" API https://review.openstack.org/78149 | 10:11 |
| openstackgerrit | Aleksandr Gordeev proposed a change to openstack-dev/devstack: Integration testing preparation for Ironic https://review.openstack.org/70348 | 10:13 |
| openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Enforces the use of Credentials https://review.openstack.org/77594 | 10:19 |
| openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Defines a Credentials class https://review.openstack.org/74387 | 10:19 |
| *** rossella-s has quit IRC | 10:19 | |
| *** rossella-s has joined #openstack-qa | 10:22 | |
| *** devvesa has joined #openstack-qa | 10:26 | |
| *** ivanzhu has quit IRC | 10:30 | |
| raies | afazekas: hi | 10:46 |
| raies | afazekas: during cloud-pipe create follwoing error is receieved | 10:47 |
| raies | "ERROR: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-1fd32495-fef8-4aba-8833-9379838544b9)" | 10:47 |
| raies | afazekas: ^^ | 10:47 |
| raies | afazekas: I run following commond "nova cloudpipe-create <admin tenant ID>" | 10:48 |
| *** mkollaro has joined #openstack-qa | 10:49 | |
| *** Madan1 has joined #openstack-qa | 10:49 | |
| *** Madan has quit IRC | 10:51 | |
| *** tosky has joined #openstack-qa | 10:52 | |
| openstackgerrit | Masayuki Igawa proposed a change to openstack/tempest: Add V3 API Test to get the cells https://review.openstack.org/78157 | 10:53 |
| raies | afazekas: giulivo: here from logs problem is FlavorMemoryTooSmall: Flavor's memory is too small for requested image. | 10:56 |
| raies | afazekas: giulivo: I updated the image by using glance image-update to --min-ram 2000 --min-disk 2 still same error | 10:56 |
| afazekas | raies: it said the flavor is too small, if you increase the image properties it probably does not helps | 11:00 |
| afazekas | You can try to switch flavor or increase the flavor settings | 11:00 |
| Anju | afazekas: hii, I would like to see your comments https://review.openstack.org/#/c/76083/ | 11:01 |
| raies | afazekas: then what I should do ?? I should boot instace with new and large flavor ?? | 11:01 |
| GMann | raies- when creating the snapshot thorugh CLI or Horizon, select the larger flavor | 11:02 |
| raies | GMann: during snapshot creation there is no option to select larger flavor | 11:04 |
| raies | GMann: I think I should boot a new VM with larger flavor | 11:04 |
| raies | GMann: wht u say ?? | 11:04 |
| *** vemana has joined #openstack-qa | 11:07 | |
| raies | GMann: I booted new VM with flavor id 5 still same error | 11:19 |
| GMann | raies- 1 min | 11:20 |
| GMann | raies-which image you are trying? | 11:23 |
| raies | GMann: instance is booted with nova cloudpipe-create | 11:23 |
| raies | c6-x86_64-20130910-1.qcow2 | 11:24 |
| andreaf | maurosr: ping | 11:24 |
| raies | instance is booted with c6-x86_64-20130910-1.qcow2 | 11:24 |
| raies | GMann: ^^ | 11:24 |
| GMann | raies-its working for me. | 11:24 |
| GMann | raies- Not sure why it is giving error in your case | 11:25 |
| GMann | raies- can you try with other enviornment | 11:25 |
| *** vemana has quit IRC | 11:25 | |
| raies | GMann: you are also using c6-x86_64-20130910-1.qcow2 ?? | 11:26 |
| raies | I exactly followed document http://docs.openstack.org/grizzly/openstack-compute/admin/content/cloudpipe-start-instance.html | 11:26 |
| raies | but during cloud-pipe create this error is found | 11:27 |
| raies | in nova api logs | 11:27 |
| raies | I am posting logs to you | 11:27 |
| GMann | raies- mine is cirros-0.3.1-x86_64-uec | 11:28 |
| raies | GMann: http://www.fpaste.org/82514/40188931/ | 11:28 |
| raies | ok | 11:28 |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Add a common admin class for Nova v2/v3 API tests https://review.openstack.org/78167 | 11:29 |
| raies | mine is c6-x86_64-20130910-1.qcow2 which is centos | 11:29 |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Add a common class for Nova v2/v3 API tests https://review.openstack.org/78137 | 11:29 |
| raies | GMann: You had asked for qcow2 so I tried on centos qcow2 | 11:29 |
| GMann | raies- tell me the exact steps | 11:30 |
| raies | GMann: Now I am trying on cirros-0.3.1-x86_64-uec-kernel and will let you know | 11:30 |
| raies | GMann: steps are as per document | 11:30 |
| GMann | raies- you have created a VM then install the necessary software and then created a snapshot of that | 11:30 |
| GMann | till now any error? | 11:30 |
| raies | GMann: No no error | 11:31 |
| raies | Error were when low flavor was seleted but later it was removed | 11:31 |
| GMann | what step you follwoed after that | 11:32 |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Verify server attributes which admin can get through Nova APIs https://review.openstack.org/77517 | 11:33 |
| raies | GMann: 1. Installing the required packages 2. Creating the server configuration template 3. Create the network scripts 4. Edit the network interface configuration file 5. estarted the machine | 11:34 |
| GMann | ok then? | 11:34 |
| raies | GMann: 6. Edit the rc.local file 7. neutron net-create | 11:34 |
| raies | netron subnet-create using above net | 11:35 |
| raies | GMann: glance image create for centos | 11:35 |
| openstackgerrit | Masayuki Igawa proposed a change to openstack/tempest: Cleanup _interface class variables in compute https://review.openstack.org/78173 | 11:35 |
| raies | 9. now time to boot an instance | 11:35 |
| GMann | so you are booting the snapshoted instance right? | 11:35 |
| raies | GMann: Instance was booted with above created network | 11:35 |
| raies | GMann: No, it is nova nova boot --flavor 5 --image c0e482e4-3594-4e76-a5b0-a8bed93f69fb --nic net-id=7c6ce352-d0f1-46cf-917d-e1eb550957b5 cloud-pipe_1 | 11:36 |
| GMann | then? | 11:36 |
| raies | instance was booted with centos image which was created using glance image | 11:37 |
| GMann | you have image which you made by snapshoting the VM (installed with all software) | 11:38 |
| GMann | are you trying to boot that? | 11:38 |
| *** rossella-s has quit IRC | 11:39 | |
| *** rossella-s has joined #openstack-qa | 11:40 | |
| raies | GMann: No sir, I have an image, first I have to register that image to glance repository using glance image-create | 11:40 |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Verify service attributes through Nova "get services" API https://review.openstack.org/78149 | 11:40 |
| *** cnesa has joined #openstack-qa | 11:41 | |
| raies | GMann: Now I will boot a instance using this newly registered image using nova boot | 11:41 |
| raies | as of above | 11:41 |
| *** ken1ohmichi has joined #openstack-qa | 11:41 | |
| GMann | ok | 11:41 |
| raies | GMann: as centos is an external image I need to register it in glance | 11:41 |
| raies | GMann: cirror is already registered | 11:41 |
| *** rossella-s has quit IRC | 11:41 | |
| raies | 5:10 | 11:41 |
| raies | GMann: ?? | 11:42 |
| *** rossella-s has joined #openstack-qa | 11:42 | |
| *** jufeng has quit IRC | 11:42 | |
| *** psharma has joined #openstack-qa | 11:43 | |
| GMann | when you took the snapshot then, it is already register to glance | 11:43 |
| GMann | or you have created that VM snapshot on otehr enviornwement? | 11:43 |
| raies | GMann: When I took a snapsot a new image with new ID is get registered in repository | 11:44 |
| raies | GMann: http://www.fpaste.org/82521/40198861/ | 11:44 |
| *** fbo is now known as fbo_away | 11:44 | |
| raies | I booted using centos63-image | 11:45 |
| raies | after snapshot saved one is - cloud-pipance | 11:45 |
| GMann | ok | 11:46 |
| GMann | cloud-pipance is register in glance right? | 11:46 |
| GMann | why you want to boot again? | 11:46 |
| raies | why I will boot again | 11:47 |
| raies | ?? | 11:47 |
| raies | GMann: my failure is during "nova cloudpipe-cretae <tenant id>" | 11:47 |
| *** mtreinish_ has joined #openstack-qa | 11:48 | |
| raies | GMann: sir what do you want to know ?? | 11:49 |
| raies | GMann: it may be problem of VM on VM | 11:53 |
| *** mkoderer_ has joined #openstack-qa | 11:54 | |
| raies | giulivo: needs approval https://review.openstack.org/#/c/77070/ | 11:54 |
| *** cnesa has quit IRC | 11:55 | |
| *** mtreinish has quit IRC | 11:55 | |
| *** akamyshnikova_ has joined #openstack-qa | 11:56 | |
| *** mtreinish_ is now known as mtreinish | 11:56 | |
| *** nati_ueno has quit IRC | 11:56 | |
| *** mkoderer has quit IRC | 11:56 | |
| *** akamyshnikova has quit IRC | 11:56 | |
| *** sbadia has quit IRC | 11:56 | |
| *** esmute has quit IRC | 11:56 | |
| *** mkoderer_ is now known as mkoderer | 11:57 | |
| *** GMann has quit IRC | 11:57 | |
| *** esmute has joined #openstack-qa | 11:57 | |
| *** sbadia has joined #openstack-qa | 11:59 | |
| *** rossella-s has quit IRC | 11:59 | |
| *** rossella-s has joined #openstack-qa | 12:01 | |
| *** sthaha has joined #openstack-qa | 12:02 | |
| *** sthaha has joined #openstack-qa | 12:02 | |
| *** rossella-s has quit IRC | 12:03 | |
| *** rossella-s has joined #openstack-qa | 12:03 | |
| maurosr | andreaf: pong | 12:04 |
| *** aysyanne has joined #openstack-qa | 12:06 | |
| *** ken1ohmichi has quit IRC | 12:09 | |
| *** chandan_kumar has joined #openstack-qa | 12:11 | |
| *** luqas has quit IRC | 12:16 | |
| *** rossella_s has joined #openstack-qa | 12:21 | |
| *** malini has joined #openstack-qa | 12:24 | |
| *** salv-orlando has quit IRC | 12:31 | |
| *** devvesa has quit IRC | 12:32 | |
| *** devvesa has joined #openstack-qa | 12:33 | |
| *** Madan1 has quit IRC | 12:40 | |
| *** rossella-s has quit IRC | 12:41 | |
| *** psharma has quit IRC | 12:44 | |
| *** rfolco has joined #openstack-qa | 12:44 | |
| openstackgerrit | Sergey Skripnick proposed a change to openstack-dev/devstack: Do not restart libvirt if n-cpu is disabled https://review.openstack.org/78190 | 12:53 |
| openstackgerrit | Mh Raies proposed a change to openstack/tempest: Volume backup details API test https://review.openstack.org/77134 | 12:59 |
| raies | giulivo: https://review.openstack.org/77134 please check your comments | 13:00 |
| *** rossella-s has joined #openstack-qa | 13:00 | |
| raies | giulivo: please point exact comment | 13:02 |
| giulivo | raies, I think it's great but | 13:05 |
| giulivo | I'm not sure I got your point about backups being a list | 13:05 |
| giulivo | I meant check that the backup we just created appears in the list | 13:05 |
| raies | giulivo: mean I should check the created backup exists | 13:07 |
| raies | ok I will do it too | 13:07 |
| giulivo | yeah that it appears in the detailed list | 13:07 |
| giulivo | we want to make sure the response shows the backup | 13:07 |
| giulivo | maybe check that a backup with such an id and name appears in the list | 13:08 |
| giulivo | or name only if it is not showing the ids there | 13:08 |
| raies | giulivo: yes will be done | 13:08 |
| *** fbo_away is now known as fbo | 13:13 | |
| *** luqas has joined #openstack-qa | 13:14 | |
| openstackgerrit | Xavier Queralt proposed a change to openstack/tempest: Unset the imageRef when booting from volume https://review.openstack.org/78194 | 13:16 |
| openstackgerrit | Mh Raies proposed a change to openstack/tempest: Volume backup details API test https://review.openstack.org/77134 | 13:28 |
| raies | giulivo: https://review.openstack.org/77134 | 13:29 |
| giulivo | raies, again | 13:30 |
| giulivo | great but have one last comment | 13:30 |
| giulivo | it's a generic comment, doesn't apply to your case but it's good to update it I think | 13:30 |
| andreaf | maurosr: hi, thanks for your comments on https://review.openstack.org/#/c/74387/. I addressed all of them and uploaded a new patchset if you want to have a look | 13:31 |
| sc68cal | anteaya: gate-tempest-dvsm-neutron for 77788 reports a pass but I see errors in the log, similar to the gate-tempest-dvsm-neutron-pg runs -> http://logs.openstack.org/88/77788/2/gate/gate-tempest-dsvm-neutron/e652887/console.html | 13:31 |
| maurosr | andreaf: sure, thank you! | 13:31 |
| sc68cal | although that just might be noise - neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api | 13:32 |
| sc68cal | the test runs passed on non-pg runs | 13:32 |
| anteaya | sc68cal: http://logs.openstack.org/88/77788/2/gate/gate-tempest-dsvm-neutron-pg/c7a1cfe/logs/screen-q-agt.txt.gz?level=ERROR | 13:36 |
| anteaya | sdague has identified as an ovs timeout issue, which apparently is a known problem | 13:36 |
| sc68cal | yaaaaay :( | 13:36 |
| sdague | well, I know it's been seen before. | 13:36 |
| sdague | someone should figure out if there is a bug tracking it | 13:37 |
| sdague | and an er query | 13:37 |
| sc68cal | is it blowing up on the --timeout flag itself ( seen it in OVS < 1.10) or the command timing out | 13:37 |
| sc68cal | oh | 13:37 |
| sc68cal | jeez I can't read | 13:37 |
| sc68cal | stderr - derp | 13:38 |
| andreaf | giulivo: hi | 13:38 |
| andreaf | giulivo: https://review.openstack.org/#/c/74387/ is the next part of the multi-auth bp, it introduces a new Credentials class, in case you have time for a review | 13:38 |
| *** rossella-s has quit IRC | 13:40 | |
| openstackgerrit | Andrea Frittoli proposed a change to openstack-dev/devstack: Inject all account details in tempest.conf https://review.openstack.org/78221 | 13:42 |
| *** rossella-s has joined #openstack-qa | 13:44 | |
| openstackgerrit | Andrea Frittoli proposed a change to openstack/tempest: Make tempest accounts independent from devstack https://review.openstack.org/77602 | 13:45 |
| *** nosnos_ has quit IRC | 13:45 | |
| *** krtaylor has quit IRC | 13:46 | |
| *** nosnos has joined #openstack-qa | 13:48 | |
| *** nosnos has quit IRC | 13:49 | |
| *** nosnos has joined #openstack-qa | 13:50 | |
| *** dkranz has joined #openstack-qa | 13:52 | |
| *** nosnos has quit IRC | 13:54 | |
| jaypipes | dkranz: around? | 13:56 |
| dkranz | jaypipes: For 4 minutes at the moment | 13:57 |
| jaypipes | dkranz: hehe, no worries, I'll catch ya laters. | 13:57 |
| dkranz | jaypipes: back around 10:30 after that | 13:57 |
| dkranz | jaypipes: I'll ping you. Topic? | 13:57 |
| jaypipes | dkranz: oh, just wanted to chat about http://lists.openstack.org/pipermail/openstack-dev/2014-March/028920.html | 13:59 |
| dkranz | jaypipes: Sure | 14:00 |
| *** yrabl has quit IRC | 14:02 | |
| *** salv-orlando has joined #openstack-qa | 14:03 | |
| *** yfried has quit IRC | 14:03 | |
| *** weshay has joined #openstack-qa | 14:04 | |
| *** amotoki has quit IRC | 14:09 | |
| *** dhellmann_ is now known as dhellmann | 14:14 | |
| *** saju_m has quit IRC | 14:15 | |
| *** mriedem has joined #openstack-qa | 14:18 | |
| openstackgerrit | A change was merged to openstack/tempest: Prepare for enabling H302 rule(services/compute/json) https://review.openstack.org/77846 | 14:19 |
| openstackgerrit | A change was merged to openstack/tempest: Split out config option registration https://review.openstack.org/77268 | 14:20 |
| openstackgerrit | A change was merged to openstack-dev/devstack: fix typo in lib/ceilometer https://review.openstack.org/77984 | 14:21 |
| openstackgerrit | A change was merged to openstack-dev/devstack: fix tgt to use 'service' instead of upstart calls https://review.openstack.org/77889 | 14:21 |
| openstackgerrit | A change was merged to openstack/tempest: Add namespaces to xml in Network client https://review.openstack.org/64130 | 14:22 |
| *** mmaglana has joined #openstack-qa | 14:29 | |
| *** mmaglana has quit IRC | 14:31 | |
| *** krtaylor has joined #openstack-qa | 14:40 | |
| *** shwetaap has joined #openstack-qa | 14:45 | |
| *** jgrimm has quit IRC | 14:52 | |
| afazekas | giulivo, dkranz, sdague: https://review.openstack.org/#/c/62886/4 Looks like this test case just failed because the cirros image, does not detects the hotplug at early boot time | 14:54 |
| *** yfujioka has quit IRC | 15:02 | |
| openstackgerrit | afazekas proposed a change to openstack/tempest: Detecting unexpectedly not deleted resources https://review.openstack.org/78251 | 15:03 |
| *** otherwiseguy has joined #openstack-qa | 15:04 | |
| sdague | afazekas: so I want nikola and jgriffith to both sign off on that before we add it back into the pool | 15:07 |
| sdague | because that test keeps having to get turned off | 15:07 |
| sdague | and I don't want to turn it on, generate new stability issues, then have to turn it off again | 15:07 |
| *** mwagner_lap has quit IRC | 15:08 | |
| afazekas | sdague: nikola assumed it is a cirros issue at the begining | 15:08 |
| sdague | sure, but make sure jgriffith is ok with turning back on that test | 15:08 |
| sdague | if both of them sign off on it, I'm +2 | 15:08 |
| afazekas | sdague: BTW: A live image can survive a lot of attachment , but I found another issue (will be reported soon) | 15:09 |
| sdague | sure, but we don't want to be introducing new races here. | 15:10 |
| afazekas | sdague: the booting from volume test case is working | 15:10 |
| afazekas | The special thing what this test case does is writing to the volume | 15:11 |
| * afazekas bye | 15:11 | |
| *** yfried has joined #openstack-qa | 15:13 | |
| *** BobBall has left #openstack-qa | 15:14 | |
| *** atiwari has joined #openstack-qa | 15:17 | |
| *** coolsvap has joined #openstack-qa | 15:27 | |
| dkranz | jaypipes: Back now | 15:35 |
| *** mdenny has joined #openstack-qa | 15:35 | |
| malini | sdague: ping | 15:36 |
| *** tkammer has quit IRC | 15:36 | |
| openstackgerrit | A change was merged to openstack/tempest: Add "delete the resized server" tests https://review.openstack.org/75767 | 15:40 |
| malini | sdague: can you please check out if the latest patchset addresses your concerns https://review.openstack.org/#/c/77832/ ? Thanks for your help! | 15:40 |
| *** yfried has quit IRC | 15:44 | |
| *** yfried has joined #openstack-qa | 15:44 | |
| jaypipes | dkranz: just in time for me to leave for the airport :( | 15:48 |
| jaypipes | dkranz: I'll post a response to your ML post and we'll take it form there? | 15:49 |
| dkranz | jaypipes: Sure. I'll be around this week. Heading some place warm? | 15:49 |
| *** Sukhdev has joined #openstack-qa | 15:51 | |
| *** chandan_kumar has quit IRC | 15:51 | |
| *** sthaha has quit IRC | 15:52 | |
| *** jgrimm has joined #openstack-qa | 15:55 | |
| shwetaap | I have a minor fix in devstack https://review.openstack.org/#/c/77707/. It needs a second core reviewer's approval. Could sdague or someone else take a quick look at it. Thanks! | 15:55 |
| jaypipes | dkranz: lol, ufortunately the other way around. been in sarasota visiting my folks... back to ohio now. | 15:55 |
| dkranz | jaypipes: Heh. I was in Sarasota visiting my folks over the weekend too :) | 15:56 |
| jaypipes | dkranz: ha! yeah, gonna miss this weather :) | 15:58 |
| *** amotoki has joined #openstack-qa | 15:58 | |
| dkranz | jaypipes: Yeah, we got lucky. Have a safe trip | 15:58 |
| openstackgerrit | Eric Windisch proposed a change to openstack/tempest: Do not setUpClass or tearDownClass V3 tests if API is disabled https://review.openstack.org/78275 | 15:58 |
| jaypipes | cheers. ciao. | 15:59 |
| *** mkollaro has quit IRC | 16:02 | |
| *** jaypipes has quit IRC | 16:03 | |
| *** yfried has quit IRC | 16:06 | |
| *** yfried has joined #openstack-qa | 16:07 | |
| *** evgenyf has joined #openstack-qa | 16:09 | |
| *** mmaglana has joined #openstack-qa | 16:09 | |
| *** kgriffs_afk is now known as kgriffs | 16:14 | |
| *** mwagner_lap has joined #openstack-qa | 16:17 | |
| *** cnesa has joined #openstack-qa | 16:18 | |
| malini | sdague, dtroyer, chmouel: can you please take a look at https://review.openstack.org/#/c/77832/ ? | 16:21 |
| *** vkozhukalov has joined #openstack-qa | 16:21 | |
| kgriffs | sdague, dtroyer, chmouel: I know you guys are super busy, but if you have a chance, it would be awesome if we could get a review on the latest patchset for this Marconi devstack change ^^^ | 16:21 |
| *** rossella-s has quit IRC | 16:21 | |
| malini | sdague, chmouel, dtroyer: Sorry for the constant pings..But I would like to know if we are in the right direction | 16:21 |
| dtroyer | kgriffs: just curious, but what makes marconi-server behave differently from the other services in devstack WRT redirection? | 16:22 |
| malini | dtroyer: kgriffs is the right person to answer tht..But just as an FYI the latest patch set does something similar to how trove handles this https://github.com/openstack-dev/devstack/blob/master/lib/trove#L205, | 16:24 |
| malini | similar as in same :) | 16:24 |
| mtreinish | evgenyf: so what did you want to discuss? | 16:24 |
| *** rfolco has quit IRC | 16:24 | |
| *** rfolco has joined #openstack-qa | 16:25 | |
| *** rossella-s has joined #openstack-qa | 16:25 | |
| *** andreaf has quit IRC | 16:25 | |
| *** mmaglana has quit IRC | 16:29 | |
| kgriffs | dtroyer: honestly, that is something we have been working very hard to figure out for a couple weeks now. | 16:32 |
| kgriffs | let me elaborate | 16:32 |
| kgriffs | so, it appears that something in marconi-server depends on stderr | 16:33 |
| kgriffs | and that devstack kills the process when we don't redirect stderr | 16:33 |
| kgriffs | but, when we redirect to a file, nothing is written out | 16:33 |
| kgriffs | we checked logging, and ensured we weren't doing anything different. Then we found that if you don't set the output logging file, oslo.logging defaults to stdout, so we now specify the file path just in case | 16:34 |
| kgriffs | then we monkey-patched sys.stdout and sys.stderr to see if anything was using "print" or sys.stderr.write directly, and nothing showed up | 16:35 |
| *** otherwiseguy has quit IRC | 16:36 | |
| dtroyer | ok, thanks. I've been wondering what would be sensitive to devstack's redirection, which is admittedly odd | 16:36 |
| kgriffs | then it was suggested that because we are using Falcon, that had something to do with it. The only place Falcon ever writes out is to the wsgi server's error stream that is passed into environ. Just to be sure, we commented out that code in Falcon and proved it was never even being called from marconi | 16:37 |
| kgriffs | we also looked at wsgiref | 16:37 |
| kgriffs | it's default handler logs requests to the console | 16:37 |
| sdague | kgriffs: so this really does concern me that we have behavior in a server that can't be figured out | 16:37 |
| kgriffs | so we tried disabling that with a custom handler that overrode the handler and that didn't help | 16:37 |
| kgriffs | sdague: it concerns me too! | 16:37 |
| dtroyer | since the trove work-around works here too, what else is common to trove? | 16:38 |
| sdague | does trove not function without that work around? | 16:38 |
| kgriffs | malini: ^^^ | 16:39 |
| dtroyer | I think it was there from the beginning | 16:39 |
| sdague | dtroyer: so we should try removing that | 16:39 |
| *** hemna__ is now known as hemna_ | 16:39 | |
| malini | SlickNik: do you remember why you had to add the redirection here https://github.com/openstack-dev/devstack/blob/0cccad43aad08487ad1712c63afed602889aaf72/lib/trove#L153 ? | 16:39 |
| sdague | kgriffs: because the problem is, after issues like this get "worked around", they never get fixed | 16:39 |
| *** markmcclain has joined #openstack-qa | 16:41 | |
| kgriffs | sdague: I agree there is some risk in that happening. We filed a bug and can ensure it is marked as a critical fix for J-1 to try and mitigate it, but the risk is there. | 16:41 |
| kgriffs | TBH, I would love to get to the root cause of this if you guys have any suggestions of other things we can try. | 16:41 |
| kgriffs | thing is, this doesn't affect real production deployments, just devstack | 16:42 |
| *** vkozhukalov has quit IRC | 16:42 | |
| kgriffs | so I am also curious as to what is different about devstack that makes this a problem | 16:42 |
| dtroyer | the obvious thing is the redirection of stdout through an awk process | 16:43 |
| kgriffs | p.s. - we did find and fix one bug that was expecting a terminal to be present. There was some code in marconi-server to disable input echoing from the keyboard, but that was removed. | 16:43 |
| *** otherwiseguy has joined #openstack-qa | 16:48 | |
| *** mrodden has quit IRC | 16:49 | |
| openstackgerrit | Dan Smith proposed a change to openstack-dev/devstack: Running neutron callback with required patches https://review.openstack.org/78052 | 16:51 |
| sdague | kgriffs: so is there an experimental job that turns on marconi, so we can see the logs here? | 16:51 |
| *** jlibosva has quit IRC | 16:51 | |
| *** balajiiyer has joined #openstack-qa | 16:52 | |
| *** balajiiyer has left #openstack-qa | 16:52 | |
| malini | sdague: are you looking for a devstack-marconi job ? | 16:54 |
| malini | sdague: this is an experimental job on the tempest patch http://logs.openstack.org/49/63449/18/experimental/check-tempest-dsvm-marconi/ce5cb55/ | 16:55 |
| malini | We have this job running on marconi pipeline as well | 16:56 |
| malini | But it doesnt run any of the tempest tests in the marconi pipeline yet (because its not merged) | 16:56 |
| sdague | malini: is that running on devstack? | 16:56 |
| *** yfried has quit IRC | 16:56 | |
| sdague | then we would have marconi logs on these patches | 16:56 |
| sdague | to help figure this out | 16:56 |
| sdague | because right now, it's all kind of blind | 16:56 |
| malini | sdague: It runs marconi on devstack, if tht's the question | 16:56 |
| *** yfried has joined #openstack-qa | 16:57 | |
| sdague | no, the question is 'is that job in devstack's experimental queue' | 16:57 |
| sdague | so we could actually see how the patch you proposed impacts it | 16:57 |
| sdague | so we'd see what the gate looked like with marconi enabled, and could experiment with things to figure out what's going on | 16:57 |
| malini | it is not on devstack's experimental queue | 16:58 |
| sdague | ok, lets fix that | 16:58 |
| sdague | then we could maybe figure this out | 16:58 |
| sdague | anyway, got to run for a bit | 16:58 |
| malini | sdague: will tht be here https://github.com/openstack-infra/config ? | 16:59 |
| sdague | yes | 16:59 |
| openstackgerrit | A change was merged to openstack/tempest: Separate negative tests for test_server_addresses https://review.openstack.org/75352 | 17:00 |
| kgriffs | nice catch, that should help! | 17:00 |
| malini | thanks! I'll add it here now | 17:00 |
| kgriffs | fwiw, I targeted the bug fix to rc1 | 17:00 |
| kgriffs | https://bugs.launchpad.net/marconi/+bug/1287490 | 17:00 |
| *** reaper has joined #openstack-qa | 17:00 | |
| *** jgrimm has quit IRC | 17:00 | |
| *** jgrimm has joined #openstack-qa | 17:00 | |
| kgriffs | (marconi's rc1, anyway) | 17:01 |
| *** mriedem1 has joined #openstack-qa | 17:03 | |
| *** rwsu has joined #openstack-qa | 17:03 | |
| dtroyer | I just threw together a little wrapper script that re-creates stack.sh's redirections and err traps to help with debugging locally: https://gist.github.com/dtroyer/9371456 I'd be curious if you can duplicate the behaviour in there... | 17:04 |
| *** markmcclain1 has joined #openstack-qa | 17:04 | |
| *** mrodden has joined #openstack-qa | 17:05 | |
| *** mriedem has quit IRC | 17:05 | |
| *** markmcclain has quit IRC | 17:06 | |
| *** amotoki has quit IRC | 17:06 | |
| *** harlowja has joined #openstack-qa | 17:07 | |
| SlickNik | malini et al: If I recally correctly, that had to be put in because at the time the trove services logged everything to stderr. | 17:09 |
| SlickNik | I know that there have been multiple fixes to the trove logging since, so I'm not sure if the issue still exists. | 17:09 |
| malini | thanks SlickNik! I'll dig through your bug list to figure out if its the same thing as marconi | 17:10 |
| *** mlavalle has joined #openstack-qa | 17:10 | |
| kgriffs | malini: can you try dtroyer's script? | 17:10 |
| malini | hmmm..maybe I missed something? | 17:11 |
| malini | aah.yes there it is | 17:11 |
| malini | I was working on adding the experimental job..so missed IRC | 17:11 |
| malini | I need a second brain to follow IRC | 17:11 |
| *** cadenzajon_ has quit IRC | 17:17 | |
| openstackgerrit | afazekas proposed a change to openstack/tempest: Stop volume leaking test_server_rescue_negative https://review.openstack.org/78312 | 17:18 |
| *** krtaylor has quit IRC | 17:23 | |
| *** KurtMartin is now known as kmartin | 17:24 | |
| malini | dtroyer: do yoi just want me to run the script on my devstack instance? | 17:24 |
| dtroyer | malini: it shouldn't need anything from DevStack…you can, I was hoping it would be enough to re-create the redirections stack.sh does to help looking at what doesn't like the redirections to the pipes | 17:25 |
| dtroyer | without running the whole thing | 17:25 |
| malini | http://paste.openstack.org/show/72658/ | 17:26 |
| dtroyer | the point would be to replace the 'ls -l' in the middle with starting marconi-server | 17:26 |
| malini | cool..let me try tht | 17:27 |
| dtroyer | as-is it is a useful way to see just what stack.sh did with the file descriptors | 17:28 |
| *** krtaylor has joined #openstack-qa | 17:30 | |
| *** openstackgerrit has quit IRC | 17:32 | |
| *** jpich has quit IRC | 17:33 | |
| *** vkozhukalov has joined #openstack-qa | 17:33 | |
| *** dims has quit IRC | 17:35 | |
| *** dims has joined #openstack-qa | 17:37 | |
| malini | kgriffs, dtroyer: http://paste.openstack.org/show/72662/ | 17:38 |
| *** evgenyf has quit IRC | 17:42 | |
| *** devvesa has quit IRC | 17:49 | |
| *** Sukhdev has quit IRC | 17:50 | |
| *** mrodden has quit IRC | 17:53 | |
| *** Sukhdev has joined #openstack-qa | 17:57 | |
| kgriffs | brb (lunch) | 18:00 |
| *** kgriffs is now known as kgriffs_afk | 18:01 | |
| *** nati_ueno has joined #openstack-qa | 18:02 | |
| *** dkorn has joined #openstack-qa | 18:03 | |
| *** fbo is now known as fbo_away | 18:07 | |
| *** dkorn has quit IRC | 18:07 | |
| *** mmaglana has joined #openstack-qa | 18:09 | |
| *** mmaglana has quit IRC | 18:19 | |
| *** mmaglana has joined #openstack-qa | 18:20 | |
| *** devvesa has joined #openstack-qa | 18:20 | |
| *** mriedem has joined #openstack-qa | 18:22 | |
| *** mmaglana has quit IRC | 18:22 | |
| *** mmaglana has joined #openstack-qa | 18:22 | |
| *** mriedem1 has quit IRC | 18:23 | |
| *** openstackgerrit has joined #openstack-qa | 18:26 | |
| *** cnesa has quit IRC | 18:31 | |
| openstackgerrit | afazekas proposed a change to openstack/tempest: Volume xml clinet translate json attribute names https://review.openstack.org/78345 | 18:32 |
| *** cnesa has joined #openstack-qa | 18:33 | |
| *** cnesa2 has joined #openstack-qa | 18:35 | |
| *** cnesa has quit IRC | 18:37 | |
| *** cnesa has joined #openstack-qa | 18:39 | |
| *** cnesa2 has quit IRC | 18:42 | |
| *** mmaglana has quit IRC | 18:44 | |
| *** Sukhdev has quit IRC | 18:47 | |
| *** gszasz has quit IRC | 18:48 | |
| *** afazekas has quit IRC | 18:50 | |
| *** safchain has quit IRC | 18:56 | |
| *** early has quit IRC | 18:58 | |
| *** kgriffs_afk is now known as kgriffs | 19:02 | |
| *** openstackgerrit has quit IRC | 19:02 | |
| *** nati_uen_ has joined #openstack-qa | 19:03 | |
| *** early has joined #openstack-qa | 19:04 | |
| *** mrodden has joined #openstack-qa | 19:05 | |
| *** nati_ueno has quit IRC | 19:06 | |
| *** jordanP has quit IRC | 19:10 | |
| *** kgriffs is now known as kgriffs_afk | 19:12 | |
| *** jhenner has quit IRC | 19:12 | |
| *** devvesa has quit IRC | 19:12 | |
| *** mrodden has quit IRC | 19:12 | |
| *** jhenner has joined #openstack-qa | 19:13 | |
| *** kgriffs_afk is now known as kgriffs | 19:14 | |
| malini | sdague: were you looking for something similar to https://github.com/openstack-infra/config/blob/master/modules/openstack_project/files/jenkins_job_builder/config/climate.yaml , for the marconi devstack experimental job ? | 19:15 |
| *** mrodden has joined #openstack-qa | 19:15 | |
| *** rms_13 has joined #openstack-qa | 19:17 | |
| *** coolsvap has quit IRC | 19:24 | |
| *** kgriffs is now known as kgriffs_afk | 19:28 | |
| *** tosky has quit IRC | 19:30 | |
| *** mmaglana has joined #openstack-qa | 19:32 | |
| *** openstackrecheck has quit IRC | 19:34 | |
| *** openstackrecheck has joined #openstack-qa | 19:34 | |
| *** kgriffs_afk is now known as kgriffs | 19:40 | |
| *** mmaglana has quit IRC | 19:53 | |
| *** vkozhukalov has quit IRC | 19:53 | |
| *** Sukhdev has joined #openstack-qa | 19:57 | |
| *** rossella-s has quit IRC | 19:59 | |
| *** mmaglana has joined #openstack-qa | 20:00 | |
| kgriffs | malini: ping | 20:01 |
| malini | kgriffs: pong | 20:01 |
| *** mmaglana has quit IRC | 20:02 | |
| *** luqas has quit IRC | 20:03 | |
| kgriffs | hey, I was just looking at your paste | 20:03 |
| kgriffs | http://paste.openstack.org/show/72662/ | 20:04 |
| kgriffs | if you try to hit marconi-server with some requests, is it fine? | 20:04 |
| kgriffs | It looks like it terminated normally from ctrl-C in your paste | 20:04 |
| *** rossella-s has joined #openstack-qa | 20:05 | |
| malini | kgriffs: it is ok,but it logs into the terminal o/p | 20:06 |
| malini | which might be an issue in no-secreen mode | 20:06 |
| kgriffs | oic | 20:06 |
| kgriffs | is there a way to tell whether those are logged to stderr vs stdout? | 20:06 |
| malini | not that I know..But I'll chk if mpanetta can help figure out | 20:09 |
| kgriffs | ok | 20:09 |
| kgriffs | Those look like output from oslo.logging to me | 20:10 |
| kgriffs | would you agree? | 20:10 |
| malini | thts what it looks like | 20:10 |
| kgriffs | do you have a file configured for logging? | 20:11 |
| malini | kgriffs: yes | 20:12 |
| kgriffs | oh really...the plot thickens | 20:12 |
| kgriffs | hmmm | 20:13 |
| malini | hmm..But the log_file doesnt show any of the calls I am making | 20:13 |
| malini | tht is weird | 20:13 |
| kgriffs | yeah. must not have found marconi.conf | 20:13 |
| malini | all the log_file has is starting & terminating | 20:13 |
| malini | it shud have | 20:14 |
| malini | ps o/p 'marconi-server --config-file /etc/marconi/marconi.conf' | 20:14 |
| *** mpanetta has joined #openstack-qa | 20:14 | |
| mpanetta | Hi | 20:15 |
| kgriffs | o/ | 20:15 |
| kgriffs | malini: hmm, when I run marconi-server in info or debug mode it does not log individual requests | 20:17 |
| kgriffs | that may be a trace level thing | 20:17 |
| * kgriffs looking | 20:18 | |
| malini | mpanetta: need some help figuring out if the logs we see are stdout vs stderr | 20:18 |
| kgriffs | malini: or, do you mean the devstack-style redirections should be piping the wsgiref output to the file? | 20:18 |
| malini | It should be going toa file | 20:19 |
| malini | dtroyer: can yoi confirm? | 20:19 |
| mpanetta | malini: Ok | 20:19 |
| *** mmaglana has joined #openstack-qa | 20:20 | |
| kgriffs | now, that's odd. We log requests in the marconi transport driver to debug | 20:20 |
| kgriffs | so I should be seeing those in my log file | 20:20 |
| * kgriffs goes off to figure that out | 20:21 | |
| malini | kgriffs: this is config file http://paste.openstack.org/show/72699/ | 20:22 |
| *** mmaglana has quit IRC | 20:23 | |
| mpanetta | So, you want to know what FD these things come from? Whether or not it is stdout or stderr correct? | 20:26 |
| mpanetta | stack@devstack-449-12:~/devstack$ ./logtest.sh | 20:26 |
| mpanetta | Before | 20:26 |
| mpanetta | 2014-03-05 20:26:18.395 16420 INFO marconi.queues.transport.wsgi.driver [-] Serving on host 23.253.44.16:8888 | 20:26 |
| mpanetta | The line "Before" is definitely stdout | 20:27 |
| mpanetta | But the log line is from stderr since I can get it to go away by doing: | 20:27 |
| mpanetta | stack@devstack-449-12:~/devstack$ ./logtest.sh 2> /dev/null | 20:27 |
| mpanetta | Does logger print to stderr? | 20:28 |
| mpanetta | I thought it went to stdout? | 20:28 |
| kgriffs | so did I, but looks like we need to revisit that assumption | 20:28 |
| *** markmcclain1 has quit IRC | 20:29 | |
| mpanetta | hrm | 20:29 |
| mpanetta | afk | 20:30 |
| *** samuelbercovici has joined #openstack-qa | 20:34 | |
| kgriffs | malini: false alarm, turns out the particular endpoint I was hitting was missing a LOG.debug line | 20:36 |
| kgriffs | anyway, let me look into oslo.logging | 20:36 |
| *** fbo_away is now known as fbo | 20:46 | |
| *** luqas has joined #openstack-qa | 20:47 | |
| *** markmcclain has joined #openstack-qa | 20:56 | |
| *** markmcclain has quit IRC | 20:57 | |
| *** markmcclain has joined #openstack-qa | 20:57 | |
| *** vkozhukalov has joined #openstack-qa | 20:59 | |
| shwetaap | sdague, chmouel, jeblair: I have a minor fix in devstack https://review.openstack.org/#/c/77707/. It needs a second core reviewer's approval. Could one of you check this out. Thanks! | 21:00 |
| *** otherwiseguy has quit IRC | 21:02 | |
| *** yassine has quit IRC | 21:02 | |
| chmouel | sweston: done | 21:02 |
| *** yassine has joined #openstack-qa | 21:03 | |
| sweston | chmouel: thank you!!!! | 21:03 |
| *** mrodden has quit IRC | 21:03 | |
| kgriffs | sdague: is there any way to know whether this patch works around the problem without it actually being merged? https://review.openstack.org/#/c/77832/ | 21:05 |
| kgriffs | basically, I want to know whether redirecting stderr really solves the problem | 21:06 |
| kgriffs | if it does, then we can be sure it is something logging to stderr that is the issue | 21:06 |
| kgriffs | (I don't want to go on a wild goose chase...) | 21:06 |
| kgriffs | malini: ^^^ | 21:07 |
| kgriffs | dtroyer: ^^^ | 21:07 |
| *** mrodden has joined #openstack-qa | 21:08 | |
| mpanetta | back | 21:08 |
| kgriffs | malini: you've seen the tests behave differently in gate vs. you local box, right? | 21:08 |
| *** aysyanne has quit IRC | 21:08 | |
| kgriffs | like, it would succeed for you locally but not in gate? | 21:09 |
| *** luqas has quit IRC | 21:09 | |
| *** andreaf has joined #openstack-qa | 21:09 | |
| *** mmaglana has joined #openstack-qa | 21:09 | |
| *** mmaglana has quit IRC | 21:10 | |
| malini | kgriffs: yes..Most of it was around the use_screen option | 21:11 |
| malini | with https://review.openstack.org/#/c/77832/, I did try with use_screen-false locally | 21:11 |
| kgriffs | oic, so maybe it is actually a safe bet that redirecting stderr will actually fix in the gate? | 21:11 |
| mpanetta | I thought we were not supposed to redirect anything? | 21:12 |
| malini | I hope so..But it wud still be good to see it actually working, before being merged | 21:12 |
| mpanetta | Did you figure out why it was printing to stderr? | 21:12 |
| malini | mpanetta: No | 21:13 |
| mpanetta | I guess that was a question for kgriffs :P | 21:13 |
| mpanetta | malini: Ah crap | 21:13 |
| mpanetta | Does it matter? | 21:13 |
| mpanetta | I guess I am still confused if writing to stderr is bad or not | 21:14 |
| kgriffs | I guess it is according to malini's latest patch, right? | 21:14 |
| kgriffs | with the redirect, it suddenly works | 21:14 |
| mpanetta | That is annoying... | 21:15 |
| kgriffs | malini: correct? | 21:15 |
| malini | yes | 21:15 |
| mpanetta | kgriffs: Did you figure out where logging was writing to stderr? | 21:15 |
| kgriffs | mpanetta: sorry, I think I'm confusing myself at this point | 21:16 |
| kgriffs | so, we have two threads | 21:16 |
| kgriffs | of thought | 21:16 |
| kgriffs | one is that wsgiref writing to stderr is causing this problem | 21:16 |
| kgriffs | the other is that oslo.logging is doing the same | 21:16 |
| kgriffs | heck, may even be both | 21:16 |
| mpanetta | Ah ok | 21:16 |
| kgriffs | mpanetta: remind me how we decided oslo.logging was writing to stderr? | 21:16 |
| * kgriffs needs more sleep | 21:17 | |
| mpanetta | The log line I pasted in here earlier was going to stderr, I assumed it was from the logger? | 21:17 |
| * kgriffs scrolls back | 21:17 | |
| *** yassine has quit IRC | 21:17 | |
| kgriffs | ok, that "serving on host blah" is the one that is going to stderr ? | 21:17 |
| mpanetta | yeah | 21:18 |
| *** yassine has joined #openstack-qa | 21:18 | |
| mpanetta | The one that says "Before" comes from the wrapper script and is to stdout | 21:18 |
| mpanetta | Maybe we need a custom logger.conf? | 21:18 |
| kgriffs | and the same message is written to both stderr and the log file? | 21:19 |
| mpanetta | I don't know, I did not look at the log. | 21:19 |
| mpanetta | Let me check | 21:19 |
| mpanetta | Looks like it. Here is what was written: | 21:20 |
| mpanetta | 2014-03-05 20:27:25.981 | 2014-03-05 20:27:22.773 16546 INFO marconi.queues.transport.wsgi.driver [-] Serving on host 23.253.44.16:8888 | 21:20 |
| kgriffs | ok, so it must have picked up marconi.conf | 21:20 |
| kgriffs | (with the log file path set in there) | 21:20 |
| mpanetta | Well this is the log file that the script is using | 21:20 |
| mpanetta | should I look at the one in marconi.conf? | 21:20 |
| kgriffs | oh | 21:20 |
| kgriffs | yeah | 21:21 |
| kgriffs | for the record, I can't understand why writing to stderr is killing the process in the first place. That would be the root cause of the root cause. ;) | 21:21 |
| mpanetta | kgriffs: I agree | 21:21 |
| *** luqas has joined #openstack-qa | 21:22 | |
| mpanetta | It is writing to /var/log/marconi/queues.log && stderr | 21:22 |
| mpanetta | Which is odd... | 21:22 |
| mpanetta | well IMO anyway | 21:23 |
| mpanetta | On one hand I kinda see why it logging to stderr when we are not telling it to is bad, but at the same time, writing to stderr should not be a bad thing. It is there for a reason :P | 21:23 |
| kgriffs | https://gist.github.com/anonymous/2a59f940981ecd475f32 | 21:23 |
| kgriffs | found that in openstack.common.log | 21:23 |
| mpanetta | Hmm can we set that to false in marconi.conf? | 21:24 |
| *** yassine has quit IRC | 21:24 | |
| kgriffs | worth a try | 21:25 |
| *** yassine has joined #openstack-qa | 21:25 | |
| *** yassine has quit IRC | 21:25 | |
| malini | shud tht be in logging.conf? | 21:25 |
| kgriffs | quick question: am I correct in assuming that running marconi-server outside devstack without a screen works OK now? | 21:26 |
| shwetaap | chmouel, dtroyer: Thanks! | 21:26 |
| kgriffs | malini: That option would go in marconi.conf | 21:26 |
| mpanetta | under what section? | 21:27 |
| mpanetta | default? | 21:27 |
| kgriffs | I would assume DEFAULT | 21:27 |
| mpanetta | ok | 21:27 |
| kgriffs | CONF.register_opts(generic_log_opts) | 21:27 |
| mpanetta | Sorry I donno what that means :( | 21:28 |
| malini | mpanetta: do you want me to update tht? | 21:28 |
| kgriffs | oh, it just means they are registering the opts at the DEFAULT scope | 21:28 |
| mpanetta | malini: Want me to ... | 21:28 |
| mpanetta | LOL | 21:28 |
| kgriffs | mpanetta: can you confirm my assumption above? | 21:29 |
| kgriffs | am I correct in assuming that running marconi-server outside devstack without a screen works OK now? | 21:29 |
| mpanetta | kgriffs: How could I do that? | 21:29 |
| mpanetta | Oh | 21:29 |
| mpanetta | I can run it with that logtest thing and it seems to start fine | 21:29 |
| mpanetta | If that is what you mean | 21:29 |
| malini | mpanetta:I just updated the config file to have use_stderr = False | 21:29 |
| mpanetta | Ok | 21:30 |
| mpanetta | That fixed it | 21:30 |
| mpanetta | All I see now is "Before" | 21:30 |
| mpanetta | It is no longer logging to stderr, as far as I can tell | 21:30 |
| kgriffs | mpanetta: I guess what I am really wanting to confirm is that someone could run marconi-server as a daemon or something and it would be fine | 21:30 |
| malini | hmm..I can try add tht option in devstack marconi.conf, & see if it'll fix it | 21:30 |
| kgriffs | mpanetta: that this is a specific devstack issue | 21:31 |
| kgriffs | malini: go! go! go! | 21:31 |
| *** rfolco has quit IRC | 21:31 | |
| kgriffs | brb | 21:31 |
| mpanetta | kgriffs: Ah, technically, in oreder to be a true daemon, you have to fork a child and close stdin stdout and stderr in the child. The parent exits. | 21:31 |
| *** kgriffs is now known as kgriffs_afk | 21:32 | |
| mpanetta | marconi-server does not meet those criteria, if you wish to be technical about it... | 21:32 |
| *** mmaglana has joined #openstack-qa | 21:34 | |
| malini | no luck with tht :( | 21:34 |
| mpanetta | Apparetly there is this: http://legacy.python.org/dev/peps/pep-3143/#correct-daemon-behaviour | 21:34 |
| mpanetta | For python specifically | 21:35 |
| mpanetta | malini, kgriffs_afk do we want marconi-server to be a proper daemon? | 21:36 |
| *** sweston has quit IRC | 21:37 | |
| malini | mpanetta: what would tht give us ? | 21:38 |
| malini | from the link you gave, I dont see anything abt writing anywhere | 21:39 |
| mpanetta | It (in theory) should fix all these issues. No more writing to stdout/stderr, no more reliance on a terminal. | 21:39 |
| mpanetta | malini: Yeah because all the open FD's are closed | 21:39 |
| mpanetta | The list of things on that link is basically what needs to be done to be a proper daemon. | 21:40 |
| mpanetta | The biggest parts are dissassociating with the controlling terminal, which means you close stdin/stdout/stderr and never write to them. | 21:41 |
| *** otherwiseguy has joined #openstack-qa | 21:41 | |
| *** kgriffs_afk is now known as kgriffs | 21:42 | |
| *** otherwiseguy has quit IRC | 21:42 | |
| malini | tht is what we are trying to figure out..so guess tht is the path to propriety ^o) | 21:42 |
| *** otherwiseguy has joined #openstack-qa | 21:42 | |
| mpanetta | ah, well, according to that PEP, there is a library for it :P | 21:42 |
| mpanetta | Else we could just do the bits that get us by. | 21:42 |
| kgriffs | hmm, do other projects do this? | 21:43 |
| kgriffs | daemonize themselves? | 21:43 |
| mpanetta | I donno in openstack, but if you have something that gets started via init, I believe it has to. | 21:44 |
| kgriffs | seems like this is better left to a real WSGI server like uwsgi or gunicorn | 21:44 |
| mpanetta | Yes, they do all that for you. | 21:44 |
| kgriffs | malini: too bad that didn't help | 21:44 |
| kgriffs | where does that leave us? | 21:45 |
| kgriffs | malini: go ahead and leave that in - one more variable removed | 21:45 |
| mpanetta | Is it even a possibility for us to use gunicorn? | 21:46 |
| kgriffs | I can't see anywhere else in log.py that references stderr | 21:46 |
| mpanetta | Or something equiv? | 21:46 |
| sdague | kgriffs: are you making log calls before you setup logging? | 21:46 |
| kgriffs | mpanetta: mmm, I would guess they would push back since it isn't the norm | 21:46 |
| kgriffs | sdague: good question. | 21:47 |
| mpanetta | kgriffs: Ah ok | 21:47 |
| kgriffs | I suspect not, because the first logline is written to both the console and the log file, so logging must be set up at that point (and have read the log-file options) | 21:48 |
| mpanetta | kgriffs: What about using this? https://pypi.python.org/pypi/python-daemon/ | 21:48 |
| *** jhenner has quit IRC | 21:48 | |
| mpanetta | That is the ref implementation of PEP-3143 | 21:48 |
| mpanetta | One question though... WHat is the purpose of marconi-server? Is it only there for the tests? | 21:50 |
| mpanetta | As far as I know nobody really uses it, usually marconi is paired with an external WSGI server... | 21:50 |
| kgriffs | sdague: I will check on that. See what is the first call to logging | 21:51 |
| kgriffs | mpanetta: it is only there for tests and for developers who want a local instance to code against (e.g., for client development) | 21:51 |
| mpanetta | Ah cool ok | 21:52 |
| mpanetta | kgriffs: I think bootstrap.py is the first place logging gets called. | 21:53 |
| mpanetta | looks like in __init__ | 21:53 |
| kgriffs | it sets up there | 21:54 |
| mpanetta | I don't see any calls before that. | 21:54 |
| *** vkozhukalov has quit IRC | 21:54 | |
| kgriffs | I inserted a pdb breakpoint and discovered the first thing that actually tries to log is L108 | 21:54 |
| mpanetta | Same file? | 21:55 |
| kgriffs | yes | 21:55 |
| kgriffs | I am verifying now whether log config was loaded at that point | 21:55 |
| kgriffs | (should be) | 21:55 |
| kgriffs | yep | 21:55 |
| kgriffs | verified | 21:56 |
| mpanetta | awesome | 21:56 |
| kgriffs | so, we aren't logging anything before things are set up | 21:56 |
| mpanetta | I gotta go, do you want me to get back on when I get home? | 21:56 |
| malini | also when the tempest-devstack experimental job runs, the first call (health check) succeeds | 21:56 |
| *** jgrimm has joined #openstack-qa | 21:57 | |
| *** mwagner_lap has quit IRC | 21:57 | |
| *** Sukhdev has quit IRC | 21:57 | |
| kgriffs | mpanetta: no sweat, we can pick this up again tomorrow | 21:57 |
| mpanetta | Ah, ok. | 21:57 |
| kgriffs | so, to summarize | 21:57 |
| kgriffs | logging doesn't seem to be to blame | 21:58 |
| kgriffs | we have tried disabling writing to stderr and verified that logging is configured before the first call to log a message | 21:58 |
| kgriffs | wsgiref, however, does seem to write to stderr | 21:58 |
| kgriffs | but, it remains a mystery why writing to stderr in the first place is a problem | 21:59 |
| kgriffs | malini: let's try the wsgiref angle. I'll ping you in #openstack-marconi | 21:59 |
| malini | ok | 21:59 |
| *** otherwiseguy has quit IRC | 22:01 | |
| *** fbo is now known as fbo_away | 22:01 | |
| *** mpanetta has quit IRC | 22:04 | |
| *** mmaglana has quit IRC | 22:11 | |
| *** otherwiseguy has joined #openstack-qa | 22:14 | |
| *** samuelbercovici has quit IRC | 22:18 | |
| *** dkranz has quit IRC | 22:18 | |
| *** vkozhukalov has joined #openstack-qa | 22:25 | |
| *** mrodden1 has joined #openstack-qa | 22:25 | |
| *** mrodden has quit IRC | 22:28 | |
| *** markmcclain has quit IRC | 22:28 | |
| *** mdenny has quit IRC | 22:32 | |
| *** rossella-s has quit IRC | 22:39 | |
| *** mdenny has joined #openstack-qa | 22:40 | |
| *** mriedem has quit IRC | 22:40 | |
| *** mdenny has quit IRC | 22:47 | |
| *** rossella_s has joined #openstack-qa | 22:49 | |
| *** rossella_s has quit IRC | 22:49 | |
| *** sweston has joined #openstack-qa | 22:52 | |
| jogo | so Bug 1285323 - Services fail to shut down on the old side of Grenade | 22:55 |
| jogo | is one of the top bugs for now :/ | 22:55 |
| jogo | grenade sigh | 22:55 |
| *** vkozhukalov has quit IRC | 22:55 | |
| jogo | sdague: ^ | 22:55 |
| sdague | yeh, I know | 22:56 |
| *** vkozhukalov has joined #openstack-qa | 22:56 | |
| sdague | there is a fix in flight that should help | 22:56 |
| sdague | oh, damn, it had a change - https://review.openstack.org/#/c/78036/ | 22:57 |
| sdague | back to the gate | 22:57 |
| jogo | sdague: I thought you were AFK | 22:57 |
| sdague | the meeting hasn't quite started yet | 22:57 |
| sdague | I'm on from my laptop | 22:57 |
| jogo | sdague: that is a stable/havana job | 22:58 |
| jogo | patch | 22:58 |
| sdague | yes | 22:58 |
| *** markmcclain has joined #openstack-qa | 22:59 | |
| mtreinish | jogo: the old side is stable/havana :) | 22:59 |
| jogo | mtreinish sdague: derp oh devstack not grenade | 23:00 |
| *** openstack has joined #openstack-qa | 23:03 | |
| *** luqas has quit IRC | 23:13 | |
| *** jamielennox|away is now known as jamielennox | 23:17 | |
| mordred | ls | 23:21 |
| mordred | gah | 23:21 |
| mordred | morganfainberg: https://review.openstack.org/78449 | 23:21 |
| jogo | clarkb: where is the ER bot? | 23:25 |
| clarkb | no clue | 23:25 |
| clarkb | jogo: its here | 23:26 |
| *** vkozhukalov has quit IRC | 23:29 | |
| jogo | clarkb: I haven't seen it comment much lately | 23:35 |
| *** mlavalle has quit IRC | 23:36 | |
| jogo | in a day? | 23:36 |
| *** mrodden1 has quit IRC | 23:36 | |
| clarkb | it saw that message | 23:37 |
| clarkb | so the irc bits are working | 23:37 |
| clarkb | and 7 minutes it did queries for https://review.openstack.org/75463 | 23:38 |
| *** yfujioka has joined #openstack-qa | 23:38 | |
| *** sthaha has joined #openstack-qa | 23:39 | |
| *** sthaha has joined #openstack-qa | 23:39 | |
| clarkb | jogo: I really don't understand what is going on. I don't see any tracebacks | 23:40 |
| clarkb | it did the filename facet listing | 23:40 |
| jogo | clarkb: netsplit? | 23:41 |
| clarkb | jogo: no its here | 23:41 |
| clarkb | openstackrecheck: hello | 23:41 |
| *** weshay has quit IRC | 23:42 | |
| jogo | hrm | 23:42 |
| clarkb | the response to the pyelasticsearch filename facet query is the last pyelasticsearch thing I see | 23:42 |
| clarkb | it just looked at https://review.openstack.org/#/c/78050/ too | 23:45 |
| clarkb | looks like it did that one a few times | 23:46 |
| *** stevebaker has quit IRC | 23:46 | |
| *** stevebaker has joined #openstack-qa | 23:46 | |
| *** otherwiseguy has quit IRC | 23:47 | |
| clarkb | jogo: I haven't followed er dev lately. Is this possibly a new bug? | 23:52 |
| jogo | clarkb: perhaps | 23:55 |
| jogo | we haven't really touched the actual code in a while | 23:56 |
| jogo | but its possible | 23:56 |
| jogo | is ES commenting on gerit? | 23:56 |
| jogo | e-r* | 23:56 |
| *** dims has quit IRC | 23:56 | |
| clarkb | jogo: no it doesn't seem to be doing much other than making the filename facet queries | 23:56 |
| clarkb | I am grepping for 'Looking for bug' in the debug logs as in theory those should show up | 23:57 |
| *** kgriffs is now known as kgriffs_afk | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!