Tuesday, 2018-03-06

claygtimburke: torgomatic: do we need assertIsScary ???00:07
openstackgerritSamuel Merritt proposed openstack/swift master: Support -d <devs> and -p <partitions> in DB replicators.  https://review.openstack.org/54862800:26
openstackgerritTim Burke proposed openstack/swift feature/deep: Stop replicating rows from large DBs to sharded containers  https://review.openstack.org/54967800:29
timburkeok, this test is becoming a thorn in my side http://logs.openstack.org/96/545496/1/gate/swift-tox-py27/9ccedce/job-output.txt.gz#_2018-03-06_00_14_23_03516000:30
timburkeand the 503s on the in-process func tests :-/ http://logs.openstack.org/57/549857/2/check/swift-tox-func/f4873d9/job-output.txt.gz#_2018-03-05_23_03_04_05213100:34
*** tovin07_ has joined #openstack-swift00:37
timburkethe good news is i can repro the lockup detector trouble locally, just have to put some load on my VM00:44
tdasilvaclayg: just looked up how to make test non-voting...had not looked into that yet, be happy to do it for probe tests00:45
tdasilvatimburke: i'm guessing it is voting since the zuul.openstack.org page doesn't show the job is (non-voting), like it does for legacy-swift-dsvm-functional-identity-v3-only00:55
*** gerardgine has quit IRC01:08
*** gerardgine has joined #openstack-swift01:09
*** germs has joined #openstack-swift01:11
openstackgerritTimur Alperovich proposed openstack/python-swiftclient master: Add close() to _RetryBody.  https://review.openstack.org/54990101:12
*** gerardgine has quit IRC01:32
*** gerardgine has joined #openstack-swift01:35
openstackgerritTimur Alperovich proposed openstack/python-swiftclient master: Add a query_string option to head_object().  https://review.openstack.org/54990601:36
*** germs has quit IRC01:40
openstackgerritSamuel Merritt proposed openstack/swift master: Temporarily disable flaky test.  https://review.openstack.org/54991701:57
openstackgerritMerged openstack/swift master: py3: port common/wsgi.py  https://review.openstack.org/54019002:04
*** bkopilov has quit IRC03:12
*** SkyRocknRoll has joined #openstack-swift03:23
*** gerardgine has quit IRC03:25
*** gerardgine has joined #openstack-swift03:26
*** gerardgine has quit IRC03:30
*** germs has joined #openstack-swift03:40
*** germs has quit IRC03:40
*** germs has joined #openstack-swift03:40
*** germs has quit IRC03:45
*** psachin has joined #openstack-swift03:50
*** links has joined #openstack-swift03:51
*** gyee has quit IRC04:03
openstackgerritMerged openstack/swift master: Tolerate 404s during setUp/tearDown in func tests  https://review.openstack.org/54906504:09
openstackgerritMerged openstack/swift feature/deep: Track cleave progress per db file rather than per node  https://review.openstack.org/54985704:09
*** itlinux has joined #openstack-swift04:19
openstackgerritMerged openstack/swift master: Temporarily disable flaky test.  https://review.openstack.org/54991704:29
openstackgerritTim Burke proposed openstack/swift master: Check whether new probe test job is voting  https://review.openstack.org/54988504:30
*** bkopilov has joined #openstack-swift04:31
openstackgerritMerged openstack/swift master: Make DB replicators ignore non-partition directories  https://review.openstack.org/54549605:11
*** cshastri_ has joined #openstack-swift06:04
*** threestrands has quit IRC06:14
*** cbartz has joined #openstack-swift06:23
*** itlinux has quit IRC06:37
*** rcernin has quit IRC07:14
*** zaitcev__ has joined #openstack-swift07:35
*** ChanServ sets mode: +v zaitcev__07:35
*** zaitcev_ has quit IRC07:39
*** hseipp has joined #openstack-swift07:41
*** armaan has joined #openstack-swift07:46
*** tovin07_ has quit IRC07:48
*** armaan_ has joined #openstack-swift07:48
*** armaan has quit IRC07:51
*** armaan_ has quit IRC07:57
*** neonpastor has quit IRC08:00
*** neonpastor has joined #openstack-swift08:02
*** armaan has joined #openstack-swift08:14
*** cshastri_ has quit IRC08:25
*** cshastri has joined #openstack-swift08:28
*** SkyRocknRoll has quit IRC08:32
*** tesseract has joined #openstack-swift08:32
*** gkadam has joined #openstack-swift08:33
acolesgood morning08:40
*** geaaru has joined #openstack-swift08:43
*** pcaruana has joined #openstack-swift08:44
*** gkadam_ has joined #openstack-swift08:46
*** gkadam_ has quit IRC08:46
*** gkadam has quit IRC08:48
*** psachin has quit IRC08:52
*** pcaruana has quit IRC08:54
*** gkadam has joined #openstack-swift08:57
*** psachin has joined #openstack-swift09:09
*** gkadam has quit IRC09:18
*** kei_yama has quit IRC09:25
*** rcernin has joined #openstack-swift09:45
*** d0ugal has quit IRC09:50
*** d0ugal has joined #openstack-swift10:07
*** gkadam has joined #openstack-swift10:08
*** gkadam has quit IRC10:09
*** gkadam has joined #openstack-swift10:10
*** gkadam has quit IRC10:13
*** gkadam has joined #openstack-swift10:14
*** gkadam has quit IRC10:15
*** gkadam has joined #openstack-swift10:16
*** gkadam has quit IRC10:19
*** gkadam has joined #openstack-swift10:20
*** gkadam has quit IRC10:21
*** gkadam has joined #openstack-swift10:21
*** gkadam has quit IRC10:23
*** gkadam has joined #openstack-swift10:23
*** gkadam has quit IRC10:26
*** gkadam has joined #openstack-swift10:27
*** gkadam has quit IRC10:28
*** gkadam has joined #openstack-swift10:29
*** gkadam_ has joined #openstack-swift10:32
*** gkadam has quit IRC10:34
*** gkadam_ has quit IRC10:35
*** gkadam_ has joined #openstack-swift10:35
*** gkadam_ has quit IRC10:38
*** cshastri has quit IRC11:01
*** cshastri has joined #openstack-swift11:03
*** foo___ has joined #openstack-swift11:03
foo___ping11:04
foo___anyone alive ?11:04
*** psachin has quit IRC11:46
*** bkopilov has quit IRC11:48
*** gkadam has joined #openstack-swift11:50
DHEmaybe11:50
*** MeltedLux has quit IRC11:56
*** MeltedLux has joined #openstack-swift11:56
openstackgerritThiago da Silva proposed openstack/swift master: Add swift probe tests to gate  https://review.openstack.org/54924811:58
*** bartden has joined #openstack-swift12:30
bartdenHi, is it possible to stream files from openstack swift? I would like to compress > encrypt > upload to openstack without touching the local disk after each operation12:30
*** mvk has quit IRC12:33
*** zhurong_ has joined #openstack-swift12:53
*** bkopilov has joined #openstack-swift13:03
*** cshastri has quit IRC13:14
*** cshastri has joined #openstack-swift13:21
*** zhurong_ has quit IRC13:42
*** szaher has quit IRC13:42
*** mvk has joined #openstack-swift13:46
*** szaher has joined #openstack-swift13:49
*** itlinux has joined #openstack-swift13:55
*** szaher has quit IRC14:00
*** bartden has quit IRC14:02
*** szaher has joined #openstack-swift14:07
*** germs has joined #openstack-swift14:11
*** germs has quit IRC14:11
*** germs has joined #openstack-swift14:11
*** germs has quit IRC14:22
*** cshastri has quit IRC14:37
*** foo___ has quit IRC14:51
*** cbartz has quit IRC14:56
*** SkyRocknRoll has joined #openstack-swift14:58
*** SkyRocknRoll has quit IRC15:02
*** itlinux has quit IRC15:09
*** SkyRocknRoll has joined #openstack-swift15:14
*** links has quit IRC15:24
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Fix shard account to always be based off root account  https://review.openstack.org/55012715:30
*** armaan has quit IRC15:40
*** armaan has joined #openstack-swift15:41
*** rcernin has quit IRC15:43
*** itlinux has joined #openstack-swift16:09
*** gkadam has quit IRC16:20
*** SkyRocknRoll has quit IRC16:22
*** zaitcev__ is now known as zaitcev16:24
*** armaan has quit IRC16:26
*** gkadam has joined #openstack-swift16:37
*** gkadam has quit IRC16:37
*** SkyRocknRoll has joined #openstack-swift16:37
*** germs has joined #openstack-swift16:39
*** germs has quit IRC16:39
*** germs has joined #openstack-swift16:39
*** patchbot has quit IRC16:40
*** patchbot has joined #openstack-swift16:41
*** germs has quit IRC16:43
*** SkyRocknRoll has quit IRC16:48
*** mvk has quit IRC16:54
*** SkyRocknRoll has joined #openstack-swift17:04
*** silor has joined #openstack-swift17:06
*** armaan has joined #openstack-swift17:13
*** geaaru has quit IRC17:23
*** hseipp has quit IRC17:23
*** gyee has joined #openstack-swift17:33
timburkein case bartden comes back, `gzip -c <file> | gpg -e -r <recipient> - | swift upload <container> - --object-name <object>` works for me17:48
notmynamegood morning17:48
*** tesseract has quit IRC18:27
*** SkyRocknRoll has quit IRC18:29
*** germs has joined #openstack-swift18:39
*** germs has quit IRC18:39
*** germs has joined #openstack-swift18:39
*** germs has quit IRC18:44
*** armaan has quit IRC18:56
openstackgerritMerged openstack/swift feature/deep: Fix shard account to always be based off root account  https://review.openstack.org/55012718:57
*** germs has joined #openstack-swift19:13
*** germs has quit IRC19:13
*** germs has joined #openstack-swift19:13
*** hseipp has joined #openstack-swift19:21
openstackgerritMerged openstack/swift master: Add swift probe tests to gate  https://review.openstack.org/54924819:32
*** hseipp has quit IRC19:36
openstackgerritTim Burke proposed openstack/swift feature/deep: Merge remote-tracking branch 'gerrit/master' into feature/deep  https://review.openstack.org/55022819:39
*** portdirect has quit IRC19:41
*** portdirect has joined #openstack-swift19:42
notmynameyay patch 34924819:42
patchbothttps://review.openstack.org/#/c/349248/ - vmware-nsx - DVS: provide a dhcp_driver class for plugin (MERGED)19:42
notmynameno, not that one19:42
notmynameyay patch 54924819:42
patchbothttps://review.openstack.org/#/c/549248/ - swift - Add swift probe tests to gate (MERGED)19:42
notmynamethat one!19:42
claygYAY!19:42
claygi mean maybe...19:42
timburkenotmyname: idk, i'm super-excited about dhcp something something :P19:42
notmynameclayg: it's fine and it'll be great. (it's not voting yet so it can't hurt anything)19:43
claygthe good part is - it'll help us keep probetests passing.  The *bad* part is - we'll probably have to keep probetests passing now :'(19:43
acolesprobe tests in the gate is scary-great19:43
notmyname:-)19:44
timburkeacoles: it prompted me to do another merge from master for feature/deep19:44
timburkewe'll see how it does... probably needs a follow-up to get the setup right for sharding19:45
acolesnooooo...that just makes life harder on feature deep!19:45
acolesJK19:45
tdasilvalol19:45
timburkethat's the beautiful thing about it being non-voting ;-)19:45
*** germs has quit IRC19:45
acolesI mean, you want this to work...and pass tests ?!?19:45
acolesevery time I say "probe tests have been cycling N times on OMM for last 40mins" ... one fails in next minute, so I'm not going to say it19:47
*** hseipp has joined #openstack-swift19:49
*** hseipp has quit IRC19:50
openstackgerritTim Burke proposed openstack/swift master: Apply remote metadata in _handle_sync_response  https://review.openstack.org/46408419:53
timburkei'm increasingly certain that we want ^^^ for feature/deep19:53
acolestimburke: yes its on my list for tomorrow19:54
*** mvk has joined #openstack-swift19:58
*** gerardgine has joined #openstack-swift20:09
*** silor has quit IRC20:12
*** silor has joined #openstack-swift20:12
clayg@timburke @torgomatic patch 549917 seems fine... but what's the plan to delete it or fix it?20:16
patchbothttps://review.openstack.org/#/c/549917/ - swift - Temporarily disable flaky test. (MERGED)20:16
timburkeclayg: ideally, we fix it. but that'll require that someone have time to figure out how to make it reliable while under load20:19
claygso is that just like a lauchpad bug?  or something we put on the meeting agenda?20:20
timburkewhich is tricky when you've got like three different things going around killing things20:20
claygKILL THEM20:20
timburkewe've go rsync_timeout, we've got the lockup detector, and we've got the timeout on the final waitall -- there are *so many* ways for things to go off the rails, and it gets worse and worse in the gate where we're resource-constrained20:22
*** gerardgine has quit IRC20:22
timburkethe best part is, you can't even trust the logging since the lockup detector might come round again before you've had a chance to log!20:23
timburkei'm pretty sure all of this contributed to me not following up on https://review.openstack.org/#/c/429015/20:24
patchbotpatch 429015 - swift - Add abort flag to replicator/reconstructor20:24
*** gerardgine has joined #openstack-swift20:25
openstackgerritAlistair Coles proposed openstack/swift feature/deep: WIP Store own shard range in the shard ranges table  https://review.openstack.org/55024620:32
acolestimburke: is it just me? git pull on feature/deep say I'm up to date but HEAD is at "Merge remote-tracking branch 'gerrit/master' into feature/deep" and we've merged four patches since then20:37
acoleshmmm, nothing made it to github https://github.com/openstack/swift/commits/feature/deep20:38
timburkeyeah, notmyname noticed something similar with master, and i saw similar with openstack/requirements a few days ago20:38
timburkeswitch your branch's upstream to gerrit/feature/deep20:39
acolesis that a permanent change or a workaround?20:41
timburkeeither? i've been running that way for a while -- it shouldn't hurt anything, and it brings your local copy closer to the canonical source of truth20:42
timburkeunless and until we ever pull a swexit :P20:43
acoleshehe20:45
openstackgerritAlistair Coles proposed openstack/swift feature/deep: WIP Store own shard range in the shard ranges table  https://review.openstack.org/55024620:52
*** gerardgine has quit IRC20:54
*** gerardgine has joined #openstack-swift20:56
notmynameI asked in -infra20:59
notmynameabout the github mirror not updating21:00
torgomaticfrom zuul import plunger21:00
notmynamesummary from -infra is "yup, it's broke. might be nova's fault. might be github's fault. someone is working on it, but there's not an ETA"21:03
notmynamein order to update your "origin" remote, run `git remote set-url origin https://git.openstack.org/openstack/swift && git fetch --all`21:13
notmynameacoles: ^21:13
-openstackstatus- NOTICE: The infrastructure team is aware of replication issues between review.openstack.org and github.com repositories. We're planning a maintenance to try and address the issue. We recommend using our official supported mirrors instead located at https://git.openstack.org.21:19
*** germs has joined #openstack-swift21:31
*** germs has quit IRC21:31
*** germs has joined #openstack-swift21:31
*** germs has quit IRC21:35
*** threestrands has joined #openstack-swift21:54
mattoliverauMorning22:00
*** itlinux has quit IRC22:04
*** SkyRocknRoll has joined #openstack-swift22:08
timburkemattoliverau: o/22:10
notmynamemattoliverau: when did you finally make it home?22:13
openstackgerritMerged openstack/python-swiftclient master: Add a query_string option to head_object().  https://review.openstack.org/54990622:15
*** rcernin has joined #openstack-swift22:20
*** silor has quit IRC22:32
mattoliverauI got home last night. So feeling pretty jetlagged. ATM bring on the coffee, lots of coffee22:36
*** germs has joined #openstack-swift22:36
claygyou just got home!?  wow.22:58
*** germs has quit IRC23:05
*** kei_yama has joined #openstack-swift23:17
openstackgerritTim Burke proposed openstack/swift feature/deep: Stop replicating rows from large DBs to sharded containers  https://review.openstack.org/54967823:37
openstackgerritMerged openstack/swift feature/deep: Merge remote-tracking branch 'gerrit/master' into feature/deep  https://review.openstack.org/55022823:39
openstackgerritMerged openstack/swift master: py3: Port more CLI tools  https://review.openstack.org/54796923:40
timburkeacoles: ^^^ is starting to get away from me -- i'm not entirely sure i like the client making decisions, and i seem to have broken a bunch of things. feel free to push over if you have a better handle on how the unit tests should look now23:40
openstackgerritTim Burke proposed openstack/swift feature/deep: Pick up the new check on feature/deep  https://review.openstack.org/55029123:42

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!