Ticket #393: fix-393-boundary-issues.darcspatch

File fix-393-boundary-issues.darcspatch, 48.7 KB (added by kevan, at 2011-08-13T21:11:42Z)

address review comments, test for and fix boundary conditions (meant for application to ticket393-MDMF-2 branch)

Line 
1Sat Aug 13 11:37:10 PDT 2011  Kevan Carstensen <kevan@isnotajoke.com>
2  * mdmf: clean up boolean expressions, correct typos, remove self._paused, and don't unconditionally initialize block hash trees, asll as suggested by davidsarahs' review comments
3
4Sat Aug 13 11:38:33 PDT 2011  Kevan Carstensen <kevan@isnotajoke.com>
5  * mutable/retrieve.py: use floor division to calculate segment boundaries, don't fetch more segments than necessary
6
7Sat Aug 13 11:39:36 PDT 2011  Kevan Carstensen <kevan@isnotajoke.com>
8  * test/test_mutable: test for incorrect div_ceil equations
9
10Sat Aug 13 14:00:05 PDT 2011  Kevan Carstensen <kevan@isnotajoke.com>
11  * mutable/filenode.py: don't fetch more segments than necesasry to update the file
12
13New patches:
14
15[mdmf: clean up boolean expressions, correct typos, remove self._paused, and don't unconditionally initialize block hash trees, asll as suggested by davidsarahs' review comments
16Kevan Carstensen <kevan@isnotajoke.com>**20110813183710
17 Ignore-this: cc6ad9f98b64f379151aa58b77b6c4e5
18] {
19hunk ./src/allmydata/mutable/retrieve.py 108
20         # during repair, we may be called upon to grab the private key, since
21         # it wasn't picked up during a verify=False checker run, and we'll
22         # need it for repair to generate a new version.
23-        self._need_privkey = fetch_privkey or verify
24-        if self._node.get_privkey() and not verify:
25-            self._need_privkey = False
26+        self._need_privkey = verify or (fetch_privkey
27+                                        and not self._node.get_privkey())
28 
29         if self._need_privkey:
30             # TODO: Evaluate the need for this. We'll use it if we want
31hunk ./src/allmydata/mutable/retrieve.py 128
32         # 3. When we are validating readers, we need to validate the
33         #    signature on the prefix. Do we? We already do this in the
34         #    servermap update?
35-        self._verify = False
36-        if verify:
37-            self._verify = True
38+        self._verify = verify
39 
40         self._status = RetrieveStatus()
41         self._status.set_storage_index(self._storage_index)
42hunk ./src/allmydata/mutable/retrieve.py 140
43         self._status.set_size(datalength)
44         self._status.set_encoding(k, N)
45         self.readers = {}
46-        self._paused = False
47-        self._paused_deferred = None
48+        self._pause_deferred = None
49         self._offset = None
50         self._read_length = None
51         self.log("got seqnum %d" % self.verinfo[0])
52hunk ./src/allmydata/mutable/retrieve.py 166
53         data for it to handle. I make the downloader stop producing new
54         data until my resumeProducing method is called.
55         """
56-        if self._paused:
57+        if self._pause_deferred is not None:
58             return
59 
60         # fired when the download is unpaused.
61hunk ./src/allmydata/mutable/retrieve.py 174
62         self._status.set_status("Paused")
63 
64         self._pause_deferred = defer.Deferred()
65-        self._paused = True
66 
67 
68     def resumeProducing(self):
69hunk ./src/allmydata/mutable/retrieve.py 181
70         I am called by my download target once it is ready to begin
71         receiving data again.
72         """
73-        if not self._paused:
74+        if self._pause_deferred is None:
75             return
76 
77hunk ./src/allmydata/mutable/retrieve.py 184
78-        self._paused = False
79         p = self._pause_deferred
80         self._pause_deferred = None
81         self._status.set_status(self._old_status)
82hunk ./src/allmydata/mutable/retrieve.py 199
83         the Deferred fires immediately. Otherwise, the Deferred fires
84         when the downloader is unpaused.
85         """
86-        if self._paused:
87+        if self._pause_deferred is not None:
88             d = defer.Deferred()
89             self._pause_deferred.addCallback(lambda ignored: d.callback(res))
90             return d
91hunk ./src/allmydata/mutable/retrieve.py 275
92         assert len(self.remaining_sharemap) >= k
93 
94         self.log("starting download")
95-        self._paused = False
96         self._started_fetching = time.time()
97 
98         self._add_active_peers()
99hunk ./src/allmydata/mutable/retrieve.py 298
100         segment with. I return the plaintext associated with that
101         segment.
102         """
103-        # shnum => block hash tree. Unusued, but setup_encoding_parameters will
104+        # shnum => block hash tree. Unused, but setup_encoding_parameters will
105         # want to set this.
106         # XXX: Make it so that it won't set this if we're just decoding.
107hunk ./src/allmydata/mutable/retrieve.py 301
108-        self._block_hash_trees = {}
109+        self._block_hash_trees = None
110         self._setup_encoding_parameters()
111         # This is the form expected by decode.
112         blocks_and_salts = blocks_and_salts.items()
113hunk ./src/allmydata/mutable/retrieve.py 366
114                  (k, n, self._num_segments, self._segment_size,
115                   self._tail_segment_size))
116 
117-        for i in xrange(self._total_shares):
118-            # So we don't have to do this later.
119-            self._block_hash_trees[i] = hashtree.IncompleteHashTree(self._num_segments)
120+        if self._block_hash_trees is not None:
121+            for i in xrange(self._total_shares):
122+                # So we don't have to do this later.
123+                self._block_hash_trees[i] = hashtree.IncompleteHashTree(self._num_segments)
124 
125         # Our last task is to tell the downloader where to start and
126         # where to stop. We use three parameters for that:
127}
128[mutable/retrieve.py: use floor division to calculate segment boundaries, don't fetch more segments than necessary
129Kevan Carstensen <kevan@isnotajoke.com>**20110813183833
130 Ignore-this: 3e272249107afd3fbc1dd30c6a4f1e31
131] {
132hunk ./src/allmydata/mutable/retrieve.py 388
133             self.log("got offset: %d" % self._offset)
134             # our start segment is the first segment containing the
135             # offset we were given.
136-            start = mathutil.div_ceil(self._offset,
137-                                      self._segment_size)
138-            # this gets us the first segment after self._offset. Then
139-            # our start segment is the one before it.
140-            start -= 1
141+            start = self._offset // self._segment_size
142 
143             assert start < self._num_segments
144             self._start_segment = start
145hunk ./src/allmydata/mutable/retrieve.py 402
146             # segment that we were asked to read.
147             self.log("got read length %d" % self._read_length)
148             end_data = self._offset + self._read_length
149-            end = mathutil.div_ceil(end_data,
150-                                    self._segment_size)
151-            end -= 1
152+            # We don't actually need to read the byte at end_data, but
153+            # the one before it.
154+            end_data = end_data - 1
155+            end = end_data // self._segment_size
156+
157             assert end < self._num_segments
158             self._last_segment = end
159             self.log("got end segment: %d" % self._last_segment)
160}
161[test/test_mutable: test for incorrect div_ceil equations
162Kevan Carstensen <kevan@isnotajoke.com>**20110813183936
163 Ignore-this: 74e6061ab2ec5e706a1235611f87d5d6
164] {
165hunk ./src/allmydata/test/test_mutable.py 10
166 from zope.interface import implements
167 from allmydata import uri, client
168 from allmydata.nodemaker import NodeMaker
169-from allmydata.util import base32, consumer, fileutil
170+from allmydata.util import base32, consumer, fileutil, mathutil
171 from allmydata.util.hashutil import tagged_hash, ssk_writekey_hash, \
172      ssk_pubkey_fingerprint_hash
173 from allmydata.util.deferredutil import gatherResults
174hunk ./src/allmydata/test/test_mutable.py 3225
175         d.addCallback(_read_data)
176         return d
177 
178+    def test_partial_read_starting_on_segment_boundary(self):
179+        d = self.mdmf_node.get_best_readable_version()
180+        c = consumer.MemoryConsumer()
181+        offset = mathutil.next_multiple(128 * 1024, 3)
182+        d.addCallback(lambda version:
183+            version.read(c, offset, 50))
184+        expected = self.data[offset:offset+50]
185+        d.addCallback(lambda ignored:
186+            self.failUnlessEqual(expected, "".join(c.chunks)))
187+        return d
188+
189+    def test_partial_read_ending_on_segment_boundary(self):
190+        d = self.mdmf_node.get_best_readable_version()
191+        c = consumer.MemoryConsumer()
192+        offset = mathutil.next_multiple(128 * 1024, 3)
193+        start = offset - 50
194+        d.addCallback(lambda version:
195+            version.read(c, start, 51))
196+        expected = self.data[offset-50:offset+1]
197+        d.addCallback(lambda ignored:
198+            self.failUnlessEqual(expected, "".join(c.chunks)))
199+        return d
200 
201     def test_read(self):
202         d = self.mdmf_node.get_best_readable_version()
203}
204[mutable/filenode.py: don't fetch more segments than necesasry to update the file
205Kevan Carstensen <kevan@isnotajoke.com>**20110813210005
206 Ignore-this: 2b0ad0533baa6f19f18851317dfc9f15
207] hunk ./src/allmydata/mutable/filenode.py 1117
208         end_segment = start_segment
209         if offset + data.get_size() < self.get_size():
210             end_data = offset + data.get_size()
211+            # The last byte we touch is the end_data'th byte, which is actually
212+            # byte end_data - 1 because bytes are zero-indexed.
213+            end_data -= 1
214             end_segment = end_data // segsize
215 
216         self._start_segment = start_segment
217
218Context:
219
220[now that tests pass with full-size keys, return test-keys to normal (522bit)
221warner@lothar.com**20110811175418
222 Ignore-this: dbce8a6699ba9a90d91cffbc8aa87900
223] 
224[fix SHARE_HASH_CHAIN_SIZE computation
225warner@lothar.com**20110811175350
226 Ignore-this: 4508359d2207c8c1b7552b546697264
227] 
228[doc: edit the explanation of K-of-N tradeoffs
229zooko@zooko.com**20110804193409
230 Ignore-this: ab6f4e35a995c2099340b5c9c5d30f40
231] 
232[doc: clean up formatting of doc/configuration.rst
233zooko@zooko.com**20110804192722
234 Ignore-this: 7a98a3a8afb7e5441ff1f534211199ba
235 reflow to 77 chars line width, M-x white-space cleanup, blank link between name and definition
236] 
237[Add test for webopen. fixes #1149
238david-sarah@jacaranda.org**20110724211659
239 Ignore-this: 1e22853f7eb05e24c3141d56a513f661
240] 
241[More idiomatic resolution of the conflict between ticket393-MDMF-2 and trunk. refs #393
242david-sarah@jacaranda.org**20110810202942
243 Ignore-this: 7fc54a30ab0bc6ce75b7d819800c1182
244] 
245[Replace the hard-coded 522-bit RSA key size used for tests with a TEST_RSA_KEY_SIZE constant defined in test/common.py (part 2). refs #393
246david-sarah@jacaranda.org**20110810202310
247 Ignore-this: 7fbd4d004279599bbcb10f7b31fb010f
248] 
249[Replace the hard-coded 522-bit RSA key size used for tests with a TEST_RSA_KEY_SIZE constant defined in test/common.py (part 1). refs #393
250david-sarah@jacaranda.org**20110810202243
251 Ignore-this: c58d8130a2f383ff4421c632499b027b
252] 
253[merge some minor conflicts in test code from the 393-2 branch and trunk
254zooko@zooko.com**20110810172139
255 Ignore-this: 4a16f13eeae585c7c1dbe18c67072c90
256] 
257[doc: eliminate the phrase "rootcap" from doc/frontends/FTP-and-SFTP.rst
258zooko@zooko.com**20110809132601
259 Ignore-this: f7e1dd212daa65c81fb57977bce24304
260 Two different people have asked me for help, saying they couldn't figure out what a "rootcap" is. Hopefully just calling it a "cap" will make it easier for them to find out from the other docs what it is.
261] 
262[doc: formatting: reflow to fill-column=77
263zooko@zooko.com**20110809132510
264 Ignore-this: 2d6d2e203d52925968b4451f36364792
265] 
266[test_client.py: relax a check in test_create_drop_uploader so that it should pass on Python 2.4.x. refs #1429
267david-sarah@jacaranda.org**20110810052504
268 Ignore-this: 1380749ceaf33c30e26c50d57476616c
269] 
270[test/common_util.py: correct fix to mkdir_nonascii. refs #1472
271david-sarah@jacaranda.org**20110810051906
272 Ignore-this: 93c0c33370bc47d95c26c4cce8e05290
273] 
274[test/common_util.py: fix a typo. refs #1472
275david-sarah@jacaranda.org**20110810044235
276 Ignore-this: f88643d7c82cb3577686d77bbff9e2bc
277] 
278[test_client.py, test_drop_upload.py: fix pyflakes warnings.
279david-sarah@jacaranda.org**20110810034505
280 Ignore-this: 1e2d71bf2f43d63cbb423d32a6f96793
281] 
282[Factor out methods dealing with non-ASCII directories and filenames from test_drop_upload.py into common_util.py. refs #1429, #1472
283david-sarah@jacaranda.org**20110810031558
284 Ignore-this: 3de8f945fa7a58fc318a1184bad0fd1a
285] 
286[test_client.py: add a test that the drop-uploader is initialized correctly by client.py. Also give the DropUploader service a name, which is necessary for the test. refs #1429
287david-sarah@jacaranda.org**20110810030538
288 Ignore-this: 13d511ea9bbe9da2dcffe4a91ce94eae
289] 
290[drop-upload: rename 'start' method to 'startService', which is what you're supposed to use to start a Service. refs #1429
291david-sarah@jacaranda.org**20110810030345
292 Ignore-this: d1f5e5c63937ea37be37324e2f1ae99d
293] 
294[test_drop_upload.py: add comment explaining why we don't use FilePath.setContent. refs #1429
295david-sarah@jacaranda.org**20110810025942
296 Ignore-this: b95358030b63cb467d1d7f1b9a9b6978
297] 
298[test_drop_upload.py: fix some grammatical and spelling nits. refs #1429
299david-sarah@jacaranda.org**20110809221231
300 Ignore-this: fd331acddd9f754173f274a34fe62f03
301] 
302[drop-upload: report the configured local directory being absent differently from it being a file
303zooko@zooko.com**20110809220930
304 Ignore-this: a08879100f5f20e609be3f0ffa3b25cc
305 refs #1429
306] 
307[drop-upload: rename the 'upload.uri' parameter to 'upload.dircap', and a couple of cleanups to error messages. refs #1429
308zooko@zooko.com**20110809220508
309 Ignore-this: 4846368cbe331e8653bdce1f314e276b
310 I rerecorded this patch, originally by David-Sarah, to use "darcs replace" instead of editing to do the renames. This uncovered one missed rename in Client.init_drop_uploader. (Which also means that code isn't exercised by the current unit tests.)
311 refs #1429
312] 
313[drop-upload test for non-existent local dir separately from test for non-directory local dir
314zooko@zooko.com**20110809220115
315 Ignore-this: cd85f345c02f5cb71b1c1527bd4ebddc
316 A candidate patch for #1429 has a bug when it is using FilePath.is_dir() to detect whether the configured local dir exists and is a directory. FilePath.is_dir() raises exception, instead of returning False, if the thing doesn't exist. This test is to make sure that DropUploader.__init__ raise different exceptions for those two cases.
317 refs #1429
318] 
319[drop-upload: unit tests for the configuration options being named "cap" instead of "uri"
320zooko@zooko.com**20110809215913
321 Ignore-this: 958c78fffb3d76b3e4817647f824e7f9
322 This is a subset of a patch that David-Sarah attached to #1429. This is just the unit-tests part of that patch, and uses darcs record instead of hunks to change the names.
323 refs #1429
324] 
325[src/allmydata/storage/server.py: use the filesystem of storage/shares/, rather than storage/, to calculate remaining space. fixes #1384
326david-sarah@jacaranda.org**20110719022752
327 Ignore-this: a4781043cfd453dbb66ae4f108d80bea
328] 
329[test_storage.py: test that we are using the filesystem of storage/shares/, rather than storage/, to calculate remaining space, and that the HTML status output reflects the values returned by fileutil.get_disk_stats. This version works with older versions of the mock library. refs #1384
330david-sarah@jacaranda.org**20110809190722
331 Ignore-this: db447caca37a459ca49563efa58db58c
332] 
333[Work around ref #1472 by having test_drop_upload delete the non-ASCII directories it creates.
334david-sarah@jacaranda.org**20110809012334
335 Ignore-this: 5881fd5db419ba8ad12e0b2a82f6c4f0
336] 
337[Remove all trailing whitespace from .py files.
338david-sarah@jacaranda.org**20110809001117
339 Ignore-this: d2658b5ce44af70cc606ae4d3085b7cc
340] 
341[test_drop_upload.py: fix unused imports. refs #1429
342david-sarah@jacaranda.org**20110808235422
343 Ignore-this: 834f6b946bfea699d7d8c743edd66671
344] 
345[Documentation for drop-upload frontend. refs #1429
346david-sarah@jacaranda.org**20110808182146
347 Ignore-this: b33110834e586c0b784d1736c2af5779
348] 
349[Drop-upload frontend, rerecorded for 1.9 beta (and correcting a minor mistake). Includes some fixes for Windows but not the Windows inotify implementation. fixes #1429
350david-sarah@jacaranda.org**20110808234049
351 Ignore-this: 67f824c7f554e9a3a85f9fd2e1123d97
352] 
353[test_web.py: fix a test failure dependent on whether simplejson.loads returns a unicode or str object.
354david-sarah@jacaranda.org**20110808213925
355 Ignore-this: f7b267be8be56fcabc968e3c89999490
356] 
357[immutable/filenode: fix pyflakes warnings
358Kevan Carstensen <kevan@isnotajoke.com>**20110807004514
359 Ignore-this: e8d875bf8b1c5571e31b0eff42ecf64c
360] 
361[test: fix assorted tests broken by MDMF changes
362Kevan Carstensen <kevan@isnotajoke.com>**20110807004459
363 Ignore-this: 9a0dc7e5c74bfe840a9fce278619a103
364] 
365[uri: add MDMF and MDMF directory caps, add extension hint support
366Kevan Carstensen <kevan@isnotajoke.com>**20110807004436
367 Ignore-this: 6486b7d4dc0e849c6b1e9cdfb6318eac
368] 
369[test/test_mutable: tests for MDMF
370Kevan Carstensen <kevan@isnotajoke.com>**20110807004414
371 Ignore-this: 29f9c3a806d67df0ed09c4f0d857d347
372 
373 These are their own patch because they cut across a lot of the changes
374 I've made in implementing MDMF in such a way as to make it difficult to
375 split them up into the other patches.
376] 
377[webapi changes for MDMF
378Kevan Carstensen <kevan@isnotajoke.com>**20110807004348
379 Ignore-this: d6d4dac680baa4c99b05882b3828796c
380 
381     - Learn how to create MDMF files and directories through the
382       mutable-type argument.
383     - Operate with the interface changes associated with MDMF and #993.
384     - Learn how to do partial updates of mutable files.
385] 
386[mutable/servermap: Rework the servermap to work with MDMF mutable files
387Kevan Carstensen <kevan@isnotajoke.com>**20110807004259
388 Ignore-this: 154b987fa0af716c41185b88ff7ee2e1
389] 
390[dirnode: teach dirnode to make MDMF directories
391Kevan Carstensen <kevan@isnotajoke.com>**20110807004224
392 Ignore-this: 765ccd6a07ff752bf6057a3dab9e5abd
393] 
394[Fix some test failures caused by #393 patch.
395david-sarah@jacaranda.org**20110802032810
396 Ignore-this: 7f65e5adb5c859af289cea7011216fef
397] 
398[docs: amend configuration, webapi documentation to talk about MDMF
399Kevan Carstensen <kevan@isnotajoke.com>**20110802022056
400 Ignore-this: 4cab9b7e4ab79cc1efdabe2d457f27a6
401] 
402[cli: teach CLI how to create MDMF mutable files
403Kevan Carstensen <kevan@isnotajoke.com>**20110802021613
404 Ignore-this: 18d0ff98e75be231eed3c53319e76936
405 
406 Specifically, 'tahoe mkdir' and 'tahoe put' now take a --mutable-type
407 argument.
408] 
409[frontends/sftpd: Resolve incompatibilities between SFTP frontend and MDMF changes
410Kevan Carstensen <kevan@isnotajoke.com>**20110802021207
411 Ignore-this: 5e0f6e961048f71d4eed6d30210ffd2e
412] 
413[mutable/layout: Define MDMF share format, write tools for working with MDMF share format
414Kevan Carstensen <kevan@isnotajoke.com>**20110802021120
415 Ignore-this: fa76ef4800939e19ba3cbc22a2eab4e
416 
417 The changes in layout.py are mostly concerned with the MDMF share
418 format. In particular, we define read and write proxy objects used by
419 retrieval, publishing, and other code to write and read the MDMF share
420 format. We create equivalent proxies for SDMF objects so that these
421 objects can be suitably general.
422] 
423[immutable/filenode: implement unified filenode interface
424Kevan Carstensen <kevan@isnotajoke.com>**20110802020905
425 Ignore-this: d9a442fc285157f134f5d1b4607c6a48
426] 
427[immutable/literal.py: Implement interface changes in literal nodes.
428Kevan Carstensen <kevan@isnotajoke.com>**20110802020814
429 Ignore-this: 4371e71a50e65ce2607c4d67d3a32171
430] 
431[test/common: Alter common test code to work with MDMF.
432Kevan Carstensen <kevan@isnotajoke.com>**20110802015643
433 Ignore-this: e564403182d0030439b168dd9f8726fa
434 
435 This mostly has to do with making the test code implement the new
436 unified filenode interfaces.
437] 
438[mutable: train checker and repairer to work with MDMF mutable files
439Kevan Carstensen <kevan@isnotajoke.com>**20110802015140
440 Ignore-this: 8b1928925bed63708b71ab0de8d4306f
441] 
442[nodemaker: teach nodemaker about MDMF caps
443Kevan Carstensen <kevan@isnotajoke.com>**20110802014926
444 Ignore-this: 430c73121b6883b99626cfd652fc65c4
445] 
446[client: teach client how to create and work with MDMF files
447Kevan Carstensen <kevan@isnotajoke.com>**20110802014811
448 Ignore-this: d72fbc4c2ca63f00d9ab9dc2919098ff
449] 
450[mutable/filenode: Modify mutable filenodes for use with MDMF
451Kevan Carstensen <kevan@isnotajoke.com>**20110802014501
452 Ignore-this: 3c230bb0ebe60a94c667b0ee0c3b28e0
453 
454 In particular:
455     - Break MutableFileNode and MutableFileVersion into distinct classes.
456     - Implement the interface modifications made for MDMF.
457     - Be aware of MDMF caps.
458     - Learn how to create and work with MDMF files.
459] 
460[nodemaker: teach nodemaker how to create MDMF mutable files
461Kevan Carstensen <kevan@isnotajoke.com>**20110802014258
462 Ignore-this: 2bf1fd4f8c1d1ad0e855c678347b76c2
463] 
464[interfaces: change interfaces to work with MDMF
465Kevan Carstensen <kevan@isnotajoke.com>**20110802014119
466 Ignore-this: 2f441022cf888c044bc9e6dd609db139
467 
468 A lot of this work concerns #993, in that it unifies (to an extent) the
469 interfaces of mutable and immutable files.
470] 
471[mutable/publish: teach the publisher how to publish MDMF mutable files
472Kevan Carstensen <kevan@isnotajoke.com>**20110802013931
473 Ignore-this: 115217ec2b289452ec774cb725da8a86
474 
475 Like the downloader, the publisher needs some substantial changes to handle multiple segment mutable files.
476] 
477[mutable/retrieve: rework the mutable downloader to handle multiple-segment files
478Kevan Carstensen <kevan@isnotajoke.com>**20110802013524
479 Ignore-this: 398d11b5cb993b50e5e4fa6e7a3856dc
480 
481 The downloader needs substantial reworking to handle multiple segment
482 mutable files, which it needs to handle for MDMF.
483] 
484[node.py: ensure that client and introducer nodes record their port number and use that port on the next restart, fixing a regression caused by #1385. fixes #1469.
485david-sarah@jacaranda.org**20110806221934
486 Ignore-this: 1aa9d340b6570320ab2f9edc89c9e0a8
487] 
488[test_runner.py: fix a race condition in the test when NODE_URL_FILE is written before PORTNUM_FILE. refs #1469
489david-sarah@jacaranda.org**20110806231842
490 Ignore-this: ab01ae7cec3a073e29eec473e64052a0
491] 
492[test_runner.py: cleanups of HOTLINE_FILE writing and removal.
493david-sarah@jacaranda.org**20110806231652
494 Ignore-this: 25f5c5d6f5d8faebb26a4ce80110a335
495] 
496[test_runner.py: remove an unused constant.
497david-sarah@jacaranda.org**20110806221416
498 Ignore-this: eade2695cbabbea9cafeaa8debe410bb
499] 
500[node.py: fix the error path for a missing config option so that it works for a Unicode base directory.
501david-sarah@jacaranda.org**20110806221007
502 Ignore-this: 4eb9cc04b2ce05182a274a0d69dafaf3
503] 
504[test_runner.py: test that client and introducer nodes record their port number and use that port on the next restart. This tests for a regression caused by ref #1385.
505david-sarah@jacaranda.org**20110806220635
506 Ignore-this: 40a0c040b142dbddd47e69b3c3712f5
507] 
508[test_runner.py: fix a bug in CreateNode.do_create introduced in changeset [5114] when the tahoe.cfg file has been written with CRLF line endings. refs #1385
509david-sarah@jacaranda.org**20110804003032
510 Ignore-this: 7b7afdcf99da6671afac2d42828883eb
511] 
512[test_client.py: repair Basic.test_error_on_old_config_files. refs #1385
513david-sarah@jacaranda.org**20110803235036
514 Ignore-this: 31e2a9c3febe55948de7e144353663e
515] 
516[test_checker.py: increase timeout for TooParallel.test_immutable again. The ARM buildslave took 38 seconds, so 40 seconds is too close to the edge; make it 80.
517david-sarah@jacaranda.org**20110803214042
518 Ignore-this: 2d8026a6b25534e01738f78d6c7495cb
519] 
520[test_runner.py: fix RunNode.test_introducer to not rely on the mtime of introducer.furl to detect when the node has restarted. Instead we detect when node.url has been written. refs #1385
521david-sarah@jacaranda.org**20110803180917
522 Ignore-this: 11ddc43b107beca42cb78af88c5c394c
523] 
524[Further improve error message about old config files. refs #1385
525david-sarah@jacaranda.org**20110803174546
526 Ignore-this: 9d6cc3c288d9863dce58faafb3855917
527] 
528[Slightly improve error message about old config files (avoid unnecessary Unicode escaping). refs #1385
529david-sarah@jacaranda.org**20110803163848
530 Ignore-this: a3e3930fba7ccf90b8db3d2ed5829df4
531] 
532[test_checker.py: increase timeout for TooParallel.test_immutable (was consistently failing on ARM buildslave).
533david-sarah@jacaranda.org**20110803163213
534 Ignore-this: d0efceaf12628e8791862b80c85b5d56
535] 
536[Fix the bug that prevents an introducer from starting when introducer.furl already exists. Also remove some dead code that used to read old config files, and rename 'warn_about_old_config_files' to reflect that it's not a warning. refs #1385
537david-sarah@jacaranda.org**20110803013212
538 Ignore-this: 2d6cd14bd06a7493b26f2027aff78f4d
539] 
540[test_runner.py: modify RunNode.test_introducer to test that starting an introducer works when the introducer.furl file already exists. refs #1385
541david-sarah@jacaranda.org**20110803012704
542 Ignore-this: 8cf7f27ac4bfbb5ad8ca4a974106d437
543] 
544[verifier: correct a bug introduced in changeset [5106] that caused us to only verify the first block of a file. refs #1395
545david-sarah@jacaranda.org**20110802172437
546 Ignore-this: 87fb77854a839ff217dce73544775b11
547] 
548[test_repairer: add a deterministic test of share data corruption that always flips the bits of the last byte of the share data. refs #1395
549david-sarah@jacaranda.org**20110802175841
550 Ignore-this: 72f54603785007e88220c8d979e08be7
551] 
552[verifier: serialize the fetching of blocks within a share so that we don't use too much RAM
553zooko@zooko.com**20110802063703
554 Ignore-this: debd9bac07dcbb6803f835a9e2eabaa1
555 
556 Shares are still verified in parallel, but within a share, don't request a
557 block until the previous block has been verified and the memory we used to hold
558 it has been freed up.
559 
560 Patch originally due to Brian. This version has a mockery-patchery-style test
561 which is "low tech" (it implements the patching inline in the test code instead
562 of using an extension of the mock.patch() function from the mock library) and
563 which unpatches in case of exception.
564 
565 fixes #1395
566] 
567[add docs about timing-channel attacks
568Brian Warner <warner@lothar.com>**20110802044541
569 Ignore-this: 73114d5f5ed9ce252597b707dba3a194
570] 
571['test-coverage' now needs PYTHONPATH=. to find TOP/twisted/plugins/
572Brian Warner <warner@lothar.com>**20110802041952
573 Ignore-this: d40f1f4cb426ea1c362fc961baedde2
574] 
575[remove nodeid from WriteBucketProxy classes and customers
576warner@lothar.com**20110801224317
577 Ignore-this: e55334bb0095de11711eeb3af827e8e8
578 refs #1363
579] 
580[remove get_serverid() from ReadBucketProxy and customers, including Checker
581warner@lothar.com**20110801224307
582 Ignore-this: 837aba457bc853e4fd413ab1a94519cb
583 and debug.py dump-share commands
584 refs #1363
585] 
586[reject old-style (pre-Tahoe-LAFS-v1.3) configuration files
587zooko@zooko.com**20110801232423
588 Ignore-this: b58218fcc064cc75ad8f05ed0c38902b
589 Check for the existence of any of them and if any are found raise exception which will abort the startup of the node.
590 This is a backwards-incompatible change for anyone who is still using old-style configuration files.
591 fixes #1385
592] 
593[whitespace-cleanup
594zooko@zooko.com**20110725015546
595 Ignore-this: 442970d0545183b97adc7bd66657876c
596] 
597[tests: use fileutil.write() instead of open() to ensure timely close even without CPython-style reference counting
598zooko@zooko.com**20110331145427
599 Ignore-this: 75aae4ab8e5fa0ad698f998aaa1888ce
600 Some of these already had an explicit close() but I went ahead and replaced them with fileutil.write() as well for the sake of uniformity.
601] 
602[Address Kevan's comment in #776 about Options classes missed when adding 'self.command_name'. refs #776, #1359
603david-sarah@jacaranda.org**20110801221317
604 Ignore-this: 8881d42cf7e6a1d15468291b0cb8fab9
605] 
606[docs/frontends/webapi.rst: change some more instances of 'delete' or 'remove' to 'unlink', change some section titles, and use two blank lines between all sections. refs #776, #1104
607david-sarah@jacaranda.org**20110801220919
608 Ignore-this: 572327591137bb05c24c44812d4b163f
609] 
610[cleanup: implement rm as a synonym for unlink rather than vice-versa. refs #776
611david-sarah@jacaranda.org**20110801220108
612 Ignore-this: 598dcbed870f4f6bb9df62de9111b343
613] 
614[docs/webapi.rst: address Kevan's comments about use of 'delete' on ref #1104
615david-sarah@jacaranda.org**20110801205356
616 Ignore-this: 4fbf03864934753c951ddeff64392491
617] 
618[docs: some changes of 'delete' or 'rm' to 'unlink'. refs #1104
619david-sarah@jacaranda.org**20110713002722
620 Ignore-this: 304d2a330d5e6e77d5f1feed7814b21c
621] 
622[WUI: change the label of the button to unlink a file from 'del' to 'unlink'. Also change some internal names to 'unlink', and allow 't=unlink' as a synonym for 't=delete' in the web-API interface. Incidentally, improve a test to check for the rename button as well as the unlink button. fixes #1104
623david-sarah@jacaranda.org**20110713001218
624 Ignore-this: 3eef6b3f81b94a9c0020a38eb20aa069
625] 
626[src/allmydata/web/filenode.py: delete a stale comment that was made incorrect by changeset [3133].
627david-sarah@jacaranda.org**20110801203009
628 Ignore-this: b3912e95a874647027efdc97822dd10e
629] 
630[fix typo introduced during rebasing of 'remove get_serverid from
631Brian Warner <warner@lothar.com>**20110801200341
632 Ignore-this: 4235b0f585c0533892193941dbbd89a8
633 DownloadStatus.add_dyhb_request and customers' patch, to fix test failure.
634] 
635[remove get_serverid from DownloadStatus.add_dyhb_request and customers
636zooko@zooko.com**20110801185401
637 Ignore-this: db188c18566d2d0ab39a80c9dc8f6be6
638 This patch is a rebase of a patch originally written by Brian. I didn't change any of the intent of Brian's patch, just ported it to current trunk.
639 refs #1363
640] 
641[remove get_serverid from DownloadStatus.add_block_request and customers
642zooko@zooko.com**20110801185344
643 Ignore-this: 8bfa8201d6147f69b0fbe31beea9c1e
644 This is a rebase of a patch Brian originally wrote. I haven't changed the intent of that patch, just ported it to trunk.
645 refs #1363
646] 
647[apply zooko's advice: storage_client get_known_servers() returns a frozenset, caller sorts
648warner@lothar.com**20110801174452
649 Ignore-this: 2aa13ea6cbed4e9084bd604bf8633692
650 refs #1363
651] 
652[test_immutable.Test: rewrite to use NoNetworkGrid, now takes 2.7s not 97s
653warner@lothar.com**20110801174444
654 Ignore-this: 54f30b5d7461d2b3514e2a0172f3a98c
655 remove now-unused ShareManglingMixin
656 refs #1363
657] 
658[DownloadStatus.add_known_share wants to be used by Finder, web.status
659warner@lothar.com**20110801174436
660 Ignore-this: 1433bcd73099a579abe449f697f35f9
661 refs #1363
662] 
663[replace IServer.name() with get_name(), and get_longname()
664warner@lothar.com**20110801174428
665 Ignore-this: e5a6f7f6687fd7732ddf41cfdd7c491b
666 
667 This patch was originally written by Brian, but was re-recorded by Zooko to use
668 darcs replace instead of hunks for any file in which it would result in fewer
669 total hunks.
670 refs #1363
671] 
672[upload.py: apply David-Sarah's advice rename (un)contacted(2) trackers to first_pass/second_pass/next_pass
673zooko@zooko.com**20110801174143
674 Ignore-this: e36e1420bba0620a0107bd90032a5198
675 This patch was written by Brian but was re-recorded by Zooko (with David-Sarah looking on) to use darcs replace instead of editing to rename the three variables to their new names.
676 refs #1363
677] 
678[Coalesce multiple Share.loop() calls, make downloads faster. Closes #1268.
679Brian Warner <warner@lothar.com>**20110801151834
680 Ignore-this: 48530fce36c01c0ff708f61c2de7e67a
681] 
682[src/allmydata/_auto_deps.py: 'i686' is another way of spelling x86.
683david-sarah@jacaranda.org**20110801034035
684 Ignore-this: 6971e0621db2fba794d86395b4d51038
685] 
686[tahoe_rm.py: better error message when there is no path. refs #1292
687david-sarah@jacaranda.org**20110122064212
688 Ignore-this: ff3bb2c9f376250e5fd77eb009e09018
689] 
690[test_cli.py: Test for error message when 'tahoe rm' is invoked without a path. refs #1292
691david-sarah@jacaranda.org**20110104105108
692 Ignore-this: 29ec2f2e0251e446db96db002ad5dd7d
693] 
694[src/allmydata/__init__.py: suppress a spurious warning from 'bin/tahoe --version[-and-path]' about twisted-web and twisted-core packages.
695david-sarah@jacaranda.org**20110801005209
696 Ignore-this: 50e7cd53cca57b1870d9df0361c7c709
697] 
698[test_cli.py: use to_str on fields loaded using simplejson.loads in new tests. refs #1304
699david-sarah@jacaranda.org**20110730032521
700 Ignore-this: d1d6dfaefd1b4e733181bf127c79c00b
701] 
702[cli: make 'tahoe cp' overwrite mutable files in-place
703Kevan Carstensen <kevan@isnotajoke.com>**20110729202039
704 Ignore-this: b2ad21a19439722f05c49bfd35b01855
705] 
706[SFTP: write an error message to standard error for unrecognized shell commands. Change the existing message for shell sessions to be written to standard error, and refactor some duplicated code. Also change the lines of the error messages to end in CRLF, and take into account Kevan's review comments. fixes #1442, #1446
707david-sarah@jacaranda.org**20110729233102
708 Ignore-this: d2f2bb4664f25007d1602bf7333e2cdd
709] 
710[src/allmydata/scripts/cli.py: fix pyflakes warning.
711david-sarah@jacaranda.org**20110728021402
712 Ignore-this: 94050140ddb99865295973f49927c509
713] 
714[Fix the help synopses of CLI commands to include [options] in the right place. fixes #1359, fixes #636
715david-sarah@jacaranda.org**20110724225440
716 Ignore-this: 2a8e488a5f63dabfa9db9efd83768a5
717] 
718[encodingutil: argv and output encodings are always the same on all platforms. Lose the unnecessary generality of them being different. fixes #1120
719david-sarah@jacaranda.org**20110629185356
720 Ignore-this: 5ebacbe6903dfa83ffd3ff8436a97787
721] 
722[docs/man/tahoe.1: add man page. fixes #1420
723david-sarah@jacaranda.org**20110724171728
724 Ignore-this: fc7601ec7f25494288d6141d0ae0004c
725] 
726[Update the dependency on zope.interface to fix an incompatiblity between Nevow and zope.interface 3.6.4. fixes #1435
727david-sarah@jacaranda.org**20110721234941
728 Ignore-this: 2ff3fcfc030fca1a4d4c7f1fed0f2aa9
729] 
730[frontends/ftpd.py: remove the check for IWriteFile.close since we're now guaranteed to be using Twisted >= 10.1 which has it.
731david-sarah@jacaranda.org**20110722000320
732 Ignore-this: 55cd558b791526113db3f83c00ec328a
733] 
734[Update the dependency on Twisted to >= 10.1. This allows us to simplify some documentation: it's no longer necessary to install pywin32 on Windows, or apply a patch to Twisted in order to use the FTP frontend. fixes #1274, #1438. refs #1429
735david-sarah@jacaranda.org**20110721233658
736 Ignore-this: 81b41745477163c9b39c0b59db91cc62
737] 
738[misc/build_helpers/run_trial.py: undo change to block pywin32 (it didn't work because run_trial.py is no longer used). refs #1334
739david-sarah@jacaranda.org**20110722035402
740 Ignore-this: 5d03f544c4154f088e26c7107494bf39
741] 
742[misc/build_helpers/run_trial.py: ensure that pywin32 is not on the sys.path when running the test suite. Includes some temporary debugging printouts that will be removed. refs #1334
743david-sarah@jacaranda.org**20110722024907
744 Ignore-this: 5141a9f83a4085ed4ca21f0bbb20bb9c
745] 
746[docs/running.rst: use 'tahoe run ~/.tahoe' instead of 'tahoe run' (the default is the current directory, unlike 'tahoe start').
747david-sarah@jacaranda.org**20110718005949
748 Ignore-this: 81837fbce073e93d88a3e7ae3122458c
749] 
750[docs/running.rst: say to put the introducer.furl in tahoe.cfg.
751david-sarah@jacaranda.org**20110717194315
752 Ignore-this: 954cc4c08e413e8c62685d58ff3e11f3
753] 
754[README.txt: say that quickstart.rst is in the docs directory.
755david-sarah@jacaranda.org**20110717192400
756 Ignore-this: bc6d35a85c496b77dbef7570677ea42a
757] 
758[setup: remove the dependency on foolscap's "secure_connections" extra, add a dependency on pyOpenSSL
759zooko@zooko.com**20110717114226
760 Ignore-this: df222120d41447ce4102616921626c82
761 fixes #1383
762] 
763[test_sftp.py cleanup: remove a redundant definition of failUnlessReallyEqual.
764david-sarah@jacaranda.org**20110716181813
765 Ignore-this: 50113380b368c573f07ac6fe2eb1e97f
766] 
767[docs: add missing link in NEWS.rst
768zooko@zooko.com**20110712153307
769 Ignore-this: be7b7eb81c03700b739daa1027d72b35
770] 
771[contrib: remove the contributed fuse modules and the entire contrib/ directory, which is now empty
772zooko@zooko.com**20110712153229
773 Ignore-this: 723c4f9e2211027c79d711715d972c5
774 Also remove a couple of vestigial references to figleaf, which is long gone.
775 fixes #1409 (remove contrib/fuse)
776] 
777[add Protovis.js-based download-status timeline visualization
778Brian Warner <warner@lothar.com>**20110629222606
779 Ignore-this: 477ccef5c51b30e246f5b6e04ab4a127
780 
781 provide status overlap info on the webapi t=json output, add decode/decrypt
782 rate tooltips, add zoomin/zoomout buttons
783] 
784[add more download-status data, fix tests
785Brian Warner <warner@lothar.com>**20110629222555
786 Ignore-this: e9e0b7e0163f1e95858aa646b9b17b8c
787] 
788[prepare for viz: improve DownloadStatus events
789Brian Warner <warner@lothar.com>**20110629222542
790 Ignore-this: 16d0bde6b734bb501aa6f1174b2b57be
791 
792 consolidate IDownloadStatusHandlingConsumer stuff into DownloadNode
793] 
794[docs: fix error in crypto specification that was noticed by Taylor R Campbell <campbell+tahoe@mumble.net>
795zooko@zooko.com**20110629185711
796 Ignore-this: b921ed60c1c8ba3c390737fbcbe47a67
797] 
798[setup.py: don't make bin/tahoe.pyscript executable. fixes #1347
799david-sarah@jacaranda.org**20110130235809
800 Ignore-this: 3454c8b5d9c2c77ace03de3ef2d9398a
801] 
802[Makefile: remove targets relating to 'setup.py check_auto_deps' which no longer exists. fixes #1345
803david-sarah@jacaranda.org**20110626054124
804 Ignore-this: abb864427a1b91bd10d5132b4589fd90
805] 
806[Makefile: add 'make check' as an alias for 'make test'. Also remove an unnecessary dependency of 'test' on 'build' and 'src/allmydata/_version.py'. fixes #1344
807david-sarah@jacaranda.org**20110623205528
808 Ignore-this: c63e23146c39195de52fb17c7c49b2da
809] 
810[Rename test_package_initialization.py to (much shorter) test_import.py .
811Brian Warner <warner@lothar.com>**20110611190234
812 Ignore-this: 3eb3dbac73600eeff5cfa6b65d65822
813 
814 The former name was making my 'ls' listings hard to read, by forcing them
815 down to just two columns.
816] 
817[tests: fix tests to accomodate [20110611153758-92b7f-0ba5e4726fb6318dac28fb762a6512a003f4c430]
818zooko@zooko.com**20110611163741
819 Ignore-this: 64073a5f39e7937e8e5e1314c1a302d1
820 Apparently none of the two authors (stercor, terrell), three reviewers (warner, davidsarah, terrell), or one committer (me) actually ran the tests. This is presumably due to #20.
821 fixes #1412
822] 
823[wui: right-align the size column in the WUI
824zooko@zooko.com**20110611153758
825 Ignore-this: 492bdaf4373c96f59f90581c7daf7cd7
826 Thanks to Ted "stercor" Rolle Jr. and Terrell Russell.
827 fixes #1412
828] 
829[docs: three minor fixes
830zooko@zooko.com**20110610121656
831 Ignore-this: fec96579eb95aceb2ad5fc01a814c8a2
832 CREDITS for arc for stats tweak
833 fix link to .zip file in quickstart.rst (thanks to ChosenOne for noticing)
834 English usage tweak
835] 
836[docs/running.rst: fix stray HTML (not .rst) link noticed by ChosenOne.
837david-sarah@jacaranda.org**20110609223719
838 Ignore-this: fc50ac9c94792dcac6f1067df8ac0d4a
839] 
840[server.py:  get_latencies now reports percentiles _only_ if there are sufficient observations for the interpretation of the percentile to be unambiguous.
841wilcoxjg@gmail.com**20110527120135
842 Ignore-this: 2e7029764bffc60e26f471d7c2b6611e
843 interfaces.py:  modified the return type of RIStatsProvider.get_stats to allow for None as a return value
844 NEWS.rst, stats.py: documentation of change to get_latencies
845 stats.rst: now documents percentile modification in get_latencies
846 test_storage.py:  test_latencies now expects None in output categories that contain too few samples for the associated percentile to be unambiguously reported.
847 fixes #1392
848] 
849[docs: revert link in relnotes.txt from NEWS.rst to NEWS, since the former did not exist at revision 5000.
850david-sarah@jacaranda.org**20110517011214
851 Ignore-this: 6a5be6e70241e3ec0575641f64343df7
852] 
853[docs: convert NEWS to NEWS.rst and change all references to it.
854david-sarah@jacaranda.org**20110517010255
855 Ignore-this: a820b93ea10577c77e9c8206dbfe770d
856] 
857[docs: remove out-of-date docs/testgrid/introducer.furl and containing directory. fixes #1404
858david-sarah@jacaranda.org**20110512140559
859 Ignore-this: 784548fc5367fac5450df1c46890876d
860] 
861[scripts/common.py: don't assume that the default alias is always 'tahoe' (it is, but the API of get_alias doesn't say so). refs #1342
862david-sarah@jacaranda.org**20110130164923
863 Ignore-this: a271e77ce81d84bb4c43645b891d92eb
864] 
865[setup: don't catch all Exception from check_requirement(), but only PackagingError and ImportError
866zooko@zooko.com**20110128142006
867 Ignore-this: 57d4bc9298b711e4bc9dc832c75295de
868 I noticed this because I had accidentally inserted a bug which caused AssertionError to be raised from check_requirement().
869] 
870[M-x whitespace-cleanup
871zooko@zooko.com**20110510193653
872 Ignore-this: dea02f831298c0f65ad096960e7df5c7
873] 
874[docs: fix typo in running.rst, thanks to arch_o_median
875zooko@zooko.com**20110510193633
876 Ignore-this: ca06de166a46abbc61140513918e79e8
877] 
878[relnotes.txt: don't claim to work on Cygwin (which has been untested for some time). refs #1342
879david-sarah@jacaranda.org**20110204204902
880 Ignore-this: 85ef118a48453d93fa4cddc32d65b25b
881] 
882[relnotes.txt: forseeable -> foreseeable. refs #1342
883david-sarah@jacaranda.org**20110204204116
884 Ignore-this: 746debc4d82f4031ebf75ab4031b3a9
885] 
886[replace remaining .html docs with .rst docs
887zooko@zooko.com**20110510191650
888 Ignore-this: d557d960a986d4ac8216d1677d236399
889 Remove install.html (long since deprecated).
890 Also replace some obsolete references to install.html with references to quickstart.rst.
891 Fix some broken internal references within docs/historical/historical_known_issues.txt.
892 Thanks to Ravi Pinjala and Patrick McDonald.
893 refs #1227
894] 
895[docs: FTP-and-SFTP.rst: fix a minor error and update the information about which version of Twisted fixes #1297
896zooko@zooko.com**20110428055232
897 Ignore-this: b63cfb4ebdbe32fb3b5f885255db4d39
898] 
899[munin tahoe_files plugin: fix incorrect file count
900francois@ctrlaltdel.ch**20110428055312
901 Ignore-this: 334ba49a0bbd93b4a7b06a25697aba34
902 fixes #1391
903] 
904[corrected "k must never be smaller than N" to "k must never be greater than N"
905secorp@allmydata.org**20110425010308
906 Ignore-this: 233129505d6c70860087f22541805eac
907] 
908[Fix a test failure in test_package_initialization on Python 2.4.x due to exceptions being stringified differently than in later versions of Python. refs #1389
909david-sarah@jacaranda.org**20110411190738
910 Ignore-this: 7847d26bc117c328c679f08a7baee519
911] 
912[tests: add test for including the ImportError message and traceback entry in the summary of errors from importing dependencies. refs #1389
913david-sarah@jacaranda.org**20110410155844
914 Ignore-this: fbecdbeb0d06a0f875fe8d4030aabafa
915] 
916[allmydata/__init__.py: preserve the message and last traceback entry (file, line number, function, and source line) of ImportErrors in the package versions string. fixes #1389
917david-sarah@jacaranda.org**20110410155705
918 Ignore-this: 2f87b8b327906cf8bfca9440a0904900
919] 
920[remove unused variable detected by pyflakes
921zooko@zooko.com**20110407172231
922 Ignore-this: 7344652d5e0720af822070d91f03daf9
923] 
924[allmydata/__init__.py: Nicer reporting of unparseable version numbers in dependencies. fixes #1388
925david-sarah@jacaranda.org**20110401202750
926 Ignore-this: 9c6bd599259d2405e1caadbb3e0d8c7f
927] 
928[update FTP-and-SFTP.rst: the necessary patch is included in Twisted-10.1
929Brian Warner <warner@lothar.com>**20110325232511
930 Ignore-this: d5307faa6900f143193bfbe14e0f01a
931] 
932[control.py: remove all uses of s.get_serverid()
933warner@lothar.com**20110227011203
934 Ignore-this: f80a787953bd7fa3d40e828bde00e855
935] 
936[web: remove some uses of s.get_serverid(), not all
937warner@lothar.com**20110227011159
938 Ignore-this: a9347d9cf6436537a47edc6efde9f8be
939] 
940[immutable/downloader/fetcher.py: remove all get_serverid() calls
941warner@lothar.com**20110227011156
942 Ignore-this: fb5ef018ade1749348b546ec24f7f09a
943] 
944[immutable/downloader/fetcher.py: fix diversity bug in server-response handling
945warner@lothar.com**20110227011153
946 Ignore-this: bcd62232c9159371ae8a16ff63d22c1b
947 
948 When blocks terminate (either COMPLETE or CORRUPT/DEAD/BADSEGNUM), the
949 _shares_from_server dict was being popped incorrectly (using shnum as the
950 index instead of serverid). I'm still thinking through the consequences of
951 this bug. It was probably benign and really hard to detect. I think it would
952 cause us to incorrectly believe that we're pulling too many shares from a
953 server, and thus prefer a different server rather than asking for a second
954 share from the first server. The diversity code is intended to spread out the
955 number of shares simultaneously being requested from each server, but with
956 this bug, it might be spreading out the total number of shares requested at
957 all, not just simultaneously. (note that SegmentFetcher is scoped to a single
958 segment, so the effect doesn't last very long).
959] 
960[immutable/downloader/share.py: reduce get_serverid(), one left, update ext deps
961warner@lothar.com**20110227011150
962 Ignore-this: d8d56dd8e7b280792b40105e13664554
963 
964 test_download.py: create+check MyShare instances better, make sure they share
965 Server objects, now that finder.py cares
966] 
967[immutable/downloader/finder.py: reduce use of get_serverid(), one left
968warner@lothar.com**20110227011146
969 Ignore-this: 5785be173b491ae8a78faf5142892020
970] 
971[immutable/offloaded.py: reduce use of get_serverid() a bit more
972warner@lothar.com**20110227011142
973 Ignore-this: b48acc1b2ae1b311da7f3ba4ffba38f
974] 
975[immutable/upload.py: reduce use of get_serverid()
976warner@lothar.com**20110227011138
977 Ignore-this: ffdd7ff32bca890782119a6e9f1495f6
978] 
979[immutable/checker.py: remove some uses of s.get_serverid(), not all
980warner@lothar.com**20110227011134
981 Ignore-this: e480a37efa9e94e8016d826c492f626e
982] 
983[add remaining get_* methods to storage_client.Server, NoNetworkServer, and
984warner@lothar.com**20110227011132
985 Ignore-this: 6078279ddf42b179996a4b53bee8c421
986 MockIServer stubs
987] 
988[upload.py: rearrange _make_trackers a bit, no behavior changes
989warner@lothar.com**20110227011128
990 Ignore-this: 296d4819e2af452b107177aef6ebb40f
991] 
992[happinessutil.py: finally rename merge_peers to merge_servers
993warner@lothar.com**20110227011124
994 Ignore-this: c8cd381fea1dd888899cb71e4f86de6e
995] 
996[test_upload.py: factor out FakeServerTracker
997warner@lothar.com**20110227011120
998 Ignore-this: 6c182cba90e908221099472cc159325b
999] 
1000[test_upload.py: server-vs-tracker cleanup
1001warner@lothar.com**20110227011115
1002 Ignore-this: 2915133be1a3ba456e8603885437e03
1003] 
1004[happinessutil.py: server-vs-tracker cleanup
1005warner@lothar.com**20110227011111
1006 Ignore-this: b856c84033562d7d718cae7cb01085a9
1007] 
1008[upload.py: more tracker-vs-server cleanup
1009warner@lothar.com**20110227011107
1010 Ignore-this: bb75ed2afef55e47c085b35def2de315
1011] 
1012[upload.py: fix var names to avoid confusion between 'trackers' and 'servers'
1013warner@lothar.com**20110227011103
1014 Ignore-this: 5d5e3415b7d2732d92f42413c25d205d
1015] 
1016[refactor: s/peer/server/ in immutable/upload, happinessutil.py, test_upload
1017warner@lothar.com**20110227011100
1018 Ignore-this: 7ea858755cbe5896ac212a925840fe68
1019 
1020 No behavioral changes, just updating variable/method names and log messages.
1021 The effects outside these three files should be minimal: some exception
1022 messages changed (to say "server" instead of "peer"), and some internal class
1023 names were changed. A few things still use "peer" to minimize external
1024 changes, like UploadResults.timings["peer_selection"] and
1025 happinessutil.merge_peers, which can be changed later.
1026] 
1027[storage_client.py: clean up test_add_server/test_add_descriptor, remove .test_servers
1028warner@lothar.com**20110227011056
1029 Ignore-this: efad933e78179d3d5fdcd6d1ef2b19cc
1030] 
1031[test_client.py, upload.py:: remove KiB/MiB/etc constants, and other dead code
1032warner@lothar.com**20110227011051
1033 Ignore-this: dc83c5794c2afc4f81e592f689c0dc2d
1034] 
1035[test: increase timeout on a network test because Francois's ARM machine hit that timeout
1036zooko@zooko.com**20110317165909
1037 Ignore-this: 380c345cdcbd196268ca5b65664ac85b
1038 I'm skeptical that the test was proceeding correctly but ran out of time. It seems more likely that it had gotten hung. But if we raise the timeout to an even more extravagant number then we can be even more certain that the test was never going to finish.
1039] 
1040[docs/configuration.rst: add a "Frontend Configuration" section
1041Brian Warner <warner@lothar.com>**20110222014323
1042 Ignore-this: 657018aa501fe4f0efef9851628444ca
1043 
1044 this points to docs/frontends/*.rst, which were previously underlinked
1045] 
1046[web/filenode.py: avoid calling req.finish() on closed HTTP connections. Closes #1366
1047"Brian Warner <warner@lothar.com>"**20110221061544
1048 Ignore-this: 799d4de19933f2309b3c0c19a63bb888
1049] 
1050[Add unit tests for cross_check_pkg_resources_versus_import, and a regression test for ref #1355. This requires a little refactoring to make it testable.
1051david-sarah@jacaranda.org**20110221015817
1052 Ignore-this: 51d181698f8c20d3aca58b057e9c475a
1053] 
1054[allmydata/__init__.py: .name was used in place of the correct .__name__ when printing an exception. Also, robustify string formatting by using %r instead of %s in some places. fixes #1355.
1055david-sarah@jacaranda.org**20110221020125
1056 Ignore-this: b0744ed58f161bf188e037bad077fc48
1057] 
1058[Refactor StorageFarmBroker handling of servers
1059Brian Warner <warner@lothar.com>**20110221015804
1060 Ignore-this: 842144ed92f5717699b8f580eab32a51
1061 
1062 Pass around IServer instance instead of (peerid, rref) tuple. Replace
1063 "descriptor" with "server". Other replacements:
1064 
1065  get_all_servers -> get_connected_servers/get_known_servers
1066  get_servers_for_index -> get_servers_for_psi (now returns IServers)
1067 
1068 This change still needs to be pushed further down: lots of code is now
1069 getting the IServer and then distributing (peerid, rref) internally.
1070 Instead, it ought to distribute the IServer internally and delay
1071 extracting a serverid or rref until the last moment.
1072 
1073 no_network.py was updated to retain parallelism.
1074] 
1075[TAG allmydata-tahoe-1.8.2
1076warner@lothar.com**20110131020101] 
1077Patch bundle hash:
1078350a4602866197c14da4473c951559ee823b814c