Ticket #833: misc-tweaks-darcspatch.txt

File misc-tweaks-darcspatch.txt, 59.3 KB (added by davidsarah, at 2010-01-27T07:12:21Z)

Miscellaneous documentation, test, and code formatting tweaks.

Line 
1Wed Jan 27 07:03:09 GMT Standard Time 2010  david-sarah@jacaranda.org
2  * Miscellaneous documentation, test, and code formatting tweaks.
3
4New patches:
5
6[Miscellaneous documentation, test, and code formatting tweaks.
7david-sarah@jacaranda.org**20100127070309
8 Ignore-this: 84ca7e4bb7c64221ae2c61144ef5edef
9] {
10hunk ./contrib/fuse/impl_c/blackmatch.py 909
11 
12 class TStat(fuse.Stat):
13     # in fuse 0.2, these are set by fuse.Stat.__init__
14-    # in fuse 0.2-pre3 (hardy) they are not. badness unsues if they're missing
15+    # in fuse 0.2-pre3 (hardy) they are not. badness ensues if they're missing
16     st_mode  = None
17     st_ino   = 0
18     st_dev   = 0
19hunk ./contrib/fuse/impl_c/blackmatch.py 1022
20     def get_uri(self):
21         return self.rw_uri or self.ro_uri
22 
23+    # TODO: rename to 'is_writeable', or switch sense to 'is_readonly', for consistency with Tahoe code
24     def writable(self):
25         return self.rw_uri and self.rw_uri != self.ro_uri
26 
27hunk ./docs/frontends/webapi.txt 73
28 these tasks. In general, everything that can be done with a PUT or DELETE can
29 also be done with a POST.
30 
31-Tahoe's web API is designed for two different consumers. The first is a
32-program that needs to manipulate the virtual file system. Such programs are
33+Tahoe's web API is designed for two different kinds of consumer. The first is
34+a program that needs to manipulate the virtual file system. Such programs are
35 expected to use the RESTful interface described above. The second is a human
36 using a standard web browser to work with the filesystem. This user is given
37 a series of HTML pages with links to download files, and forms that use POST
38hunk ./docs/frontends/webapi.txt 81
39 actions to upload, rename, and delete files.
40 
41 When an error occurs, the HTTP response code will be set to an appropriate
42-400-series code (like 404 for an unknown childname, or 400 Gone when a file
43-is unrecoverable due to insufficient shares), and the HTTP response body will
44-usually contain a few lines of explanation as to the cause of the error and
45-possible responses. Unusual exceptions may result in a 500 Internal Server
46-Error as a catch-all, with a default response body will contain a
47-Nevow-generated HTML-ized representation of the Python exception stack trace
48+400-series code (like 404 Not Found for an unknown childname, or 400 Bad Request
49+when the parameters to a webapi operation are invalid), and the HTTP response
50+body will usually contain a few lines of explanation as to the cause of the
51+error and possible responses. Unusual exceptions may result in a
52+500 Internal Server Error as a catch-all, with a default response body containing
53+a Nevow-generated HTML-ized representation of the Python exception stack trace
54 that caused the problem. CLI programs which want to copy the response body to
55 stderr should provide an "Accept: text/plain" header to their requests to get
56 a plain text stack trace instead. If the Accept header contains */*, or
57hunk ./docs/frontends/webapi.txt 111
58 read- and write- caps, which start with "URI:SSK", and give access to mutable
59 files.
60 
61-(later versions of Tahoe will make these strings shorter, and will remove the
62+(Later versions of Tahoe will make these strings shorter, and will remove the
63 unfortunate colons, which must be escaped when these caps are embedded in
64hunk ./docs/frontends/webapi.txt 113
65-URLs).
66+URLs.)
67 
68 To refer to any Tahoe object through the web API, you simply need to combine
69 a prefix (which indicates the HTTP server to use) with the cap (which
70hunk ./docs/frontends/webapi.txt 124
71  http://127.0.0.1:3456/uri/ + $CAP
72 
73 So, to access the directory named above (which happens to be the
74-publically-writable sample directory on the Tahoe test grid, described at
75+publically-writeable sample directory on the Tahoe test grid, described at
76 http://allmydata.org/trac/tahoe/wiki/TestGrid), the URL would be:
77 
78  http://127.0.0.1:3456/uri/URI%3ADIR2%3Adjrdkfawoqihigoett4g6auz6a%3Ajx5mplfpwexnoqff7y5e4zjus4lidm76dcuarpct7cckorh2dpgq/
79hunk ./docs/frontends/webapi.txt 198
80 representable as such.
81 
82 All Tahoe operations that refer to existing files or directories must include
83-a suitable read- or write- cap in the URL: the wapi server won't add one
84+a suitable read- or write- cap in the URL: the webapi server won't add one
85 for you. If you don't know the cap, you can't access the file. This allows
86hunk ./docs/frontends/webapi.txt 200
87-the security properties of Tahoe caps to be extended across the wapi
88+the security properties of Tahoe caps to be extended across the webapi
89 interface.
90 
91 == Slow Operations, Progress, and Cancelling ==
92hunk ./docs/frontends/webapi.txt 274
93    since the operation completed) will remain valid for ten minutes.
94 
95 Many "slow" operations can begin to use unacceptable amounts of memory when
96-operation on large directory structures. The memory usage increases when the
97+operating on large directory structures. The memory usage increases when the
98 ophandle is polled, as the results must be copied into a JSON string, sent
99 over the wire, then parsed by a client. So, as an alternative, many "slow"
100 operations have streaming equivalents. These equivalents do not use operation
101hunk ./docs/frontends/webapi.txt 314
102  retrieve the same contents that were just uploaded. This will create any
103  necessary intermediate subdirectories.
104 
105- To use the /uri/$FILECAP form, $FILECAP be a write-cap for a mutable file.
106+ To use the /uri/$FILECAP form, $FILECAP must be a write-cap for a mutable file.
107 
108  In the /uri/$DIRCAP/[SUBDIRS../]FILENAME form, if the target file is a
109hunk ./docs/frontends/webapi.txt 317
110- writable mutable file, that files contents will be overwritten in-place. If
111+ writeable mutable file, that file's contents will be overwritten in-place. If
112  it is a read-cap for a mutable file, an error will occur. If it is an
113  immutable file, the old file will be discarded, and a new one will be put in
114  its place.
115hunk ./docs/frontends/webapi.txt 336
116 PUT /uri
117 
118  This uploads a file, and produces a file-cap for the contents, but does not
119- attach the file into the virtual drive. No directories will be modified by
120+ attach the file into the filesystem. No directories will be modified by
121  this operation. The file-cap is returned as the body of the HTTP response.
122 
123  If "mutable=true" is in the query arguments, the operation will create a
124hunk ./docs/frontends/webapi.txt 350
125 
126  Create a new empty directory and return its write-cap as the HTTP response
127  body. This does not make the newly created directory visible from the
128- virtual drive. The "PUT" operation is provided for backwards compatibility:
129+ filesystem. The "PUT" operation is provided for backwards compatibility:
130  new code should use POST.
131 
132 POST /uri?t=mkdir-with-children
133hunk ./docs/frontends/webapi.txt 391
134             "linkcrtime": 1202777696.7564139,
135             "linkmotime": 1202777696.7564139,
136           } } } ]
137- }
138+  }
139 
140  Note that the webapi-using client application must not provide the
141  "Content-Type: multipart/form-data" header that usually accompanies HTML
142hunk ./docs/frontends/webapi.txt 453
143  As above, but the new directory will be populated with initial children via
144  the POST request body, as described in /uri?t=mkdir-with-children above.
145  Note that the name= argument must be passed as a queryarg, because the POST
146- request body is used for the initial children JSON.
147+ request body is used for the initial children JSON.
148 
149 POST /uri/$DIRCAP/[SUBDIRS../]?t=mkdir-immutable&name=NAME
150 
151hunk ./docs/frontends/webapi.txt 549
152 
153   Then the rw_uri field will be present in the information about a directory
154   if and only if you have read-write access to that directory. The verify_uri
155-  field will be presend if and only if the object has a verify-cap
156+  field will be present if and only if the object has a verify-cap
157   (non-distributed LIT files do not have verify-caps).
158 
159 ==== About the metadata ====
160hunk ./docs/frontends/webapi.txt 625
161   link points.
162 
163   4. Also, quite apart from Tahoe, you might be confused about the meaning of
164-  the 'ctime' in unix local filesystems, which people sometimes think means
165-  file creation time, but which actually means, in unix local filesystems, the
166+  the 'ctime' in UNIX local filesystems, which people sometimes think means
167+  file creation time, but which actually means, in UNIX local filesystems, the
168   most recent time that the file contents or the file metadata (such as owner,
169   permission bits, extended attributes, etc.) has changed. Note that although
170hunk ./docs/frontends/webapi.txt 629
171-  'ctime' does not mean file creation time in Unix, it does mean link creation
172+  'ctime' does not mean file creation time in UNIX, it does mean link creation
173   time in Tahoe, unless the "tahoe backup" command has been used on that link,
174   in which case it means something about the local filesystem file which
175   corresponds to the Tahoe file which is pointed at by the link. It means
176hunk ./docs/frontends/webapi.txt 637
177   Windows) or file-contents-or-metadata-update-time of the local file (if
178   "tahoe backup" was run on a different operating system).
179 
180-
181 === Attaching an existing File or Directory by its read- or write- cap ===
182 
183 PUT /uri/$DIRCAP/[SUBDIRS../]CHILDNAME?t=uri
184hunk ./docs/frontends/webapi.txt 660
185   if there is already an object at the given location, rather than
186   overwriting the existing object. To allow the operation to overwrite a
187   file, but return an error when trying to overwrite a directory, use
188-  "replace=only-files" (this behavior is closer to the traditional unix "mv"
189+  "replace=only-files" (this behavior is closer to the traditional UNIX "mv"
190   command). Note that "true", "t", and "1" are all synonyms for "True", and
191   "false", "f", and "0" are synonyms for "False", and the parameter is
192   case-insensitive.
193hunk ./docs/frontends/webapi.txt 664
194
195+  Note that this operation does not take its child cap in the form of
196+  separate "rw_uri" and "ro_uri" fields. Therefore, it cannot accept a
197+  child cap in a format unknown to the webapi server, because the server
198+  is not able to attenuate an unknown write cap to a read cap.
199 
200 === Adding multiple files or directories to a parent directory at once ===
201 
202hunk ./docs/frontends/webapi.txt 728
203   The object will only become completely unreachable once 1: there are no
204   reachable directories that reference it, and 2: nobody is holding a read-
205   or write- cap to the object. (This behavior is very similar to the way
206-  hardlinks and anonymous files work in traditional unix filesystems).
207+  hardlinks and anonymous files work in traditional UNIX filesystems).
208 
209   This operation will not modify more than a single directory. Intermediate
210   directories which were implicitly created by PUT or POST methods will *not*
211hunk ./docs/frontends/webapi.txt 857
212 POST /uri?t=upload
213 
214  This uploads a file, and produces a file-cap for the contents, but does not
215- attach the file into the virtual drive. No directories will be modified by
216+ attach the file into the filesystem. No directories will be modified by
217  this operation.
218 
219  The file must be provided as the "file" field of an HTML encoded form body,
220hunk ./docs/frontends/webapi.txt 1597
221 
222 == Static Files in /public_html ==
223 
224-The wapi server will take any request for a URL that starts with /static
225+The webapi server will take any request for a URL that starts with /static
226 and serve it from a configurable directory which defaults to
227 $BASEDIR/public_html . This is configured by setting the "[node]web.static"
228 value in $BASEDIR/tahoe.cfg . If this is left at the default value of
229hunk ./docs/frontends/webapi.txt 1605
230 served with the contents of the file $BASEDIR/public_html/subdir/foo.html .
231 
232 This can be useful to serve a javascript application which provides a
233-prettier front-end to the rest of the Tahoe wapi.
234+prettier front-end to the rest of the Tahoe webapi.
235 
236 
237hunk ./docs/frontends/webapi.txt 1608
238-== safety and security issues -- names vs. URIs ==
239+== Safety and security issues -- names vs. URIs ==
240 
241 Summary: use explicit file- and dir- caps whenever possible, to reduce the
242 potential for surprises when the filesystem structure is changed.
243hunk ./docs/frontends/webapi.txt 1683
244 
245 Tahoe nodes implement internal serialization to make sure that a single Tahoe
246 node cannot conflict with itself. For example, it is safe to issue two
247-directory modification requests to a single tahoe node's wapi server at the
248+directory modification requests to a single tahoe node's webapi server at the
249 same time, because the Tahoe node will internally delay one of them until
250 after the other has finished being applied. (This feature was introduced in
251 Tahoe-1.1; back with Tahoe-1.0 the web client was responsible for serializing
252hunk ./relnotes.txt 1
253-ANNOUNCING Tahoe, the Lofty-Atmospheric Filesystem, v1.5
254+ANNOUNCING Tahoe, the Lofty-Atmospheric Filesystem, v1.6
255 
256 The Tahoe-LAFS team is pleased to announce the immediate
257hunk ./relnotes.txt 4
258-availability of version 1.5 of Tahoe, the Lofty Atmospheric
259+availability of version 1.6 of Tahoe, the Lofty Atmospheric
260 File System.
261 
262 Tahoe-LAFS is the first cloud storage technology which offers
263hunk ./relnotes.txt 32
264 
265 COMPATIBILITY
266 
267-Version 1.5 is fully compatible with the version 1 series of
268-Tahoe-LAFS. Files written by v1.5 clients can be read by
269-clients of all versions back to v1.0. v1.5 clients can read
270-files produced by clients of all versions since v1.0.  v1.5
271-servers can serve clients of all versions back to v1.0 and v1.5
272+Version 1.6 is fully compatible with the version 1 series of
273+Tahoe-LAFS. Files written by v1.6 clients can be read by
274+clients of all versions back to v1.0. v1.6 clients can read
275+files produced by clients of all versions since v1.0.  v1.6
276+servers can serve clients of all versions back to v1.0 and v1.6
277 clients can use servers of all versions back to v1.0.
278 
279hunk ./relnotes.txt 39
280-This is the sixth release in the version 1 series. The version
281-1 series of Tahoe-LAFS will be actively supported and
282+In addition, version 1.6 improves forward-compatibility with
283+planned future cap formats, allowing updates to a directory
284+containing both current and future caps, without loss of
285+information.
286+
287+This is the seventh major release in the version 1 series. The
288+version 1 series of Tahoe-LAFS will be actively supported and
289 maintained for the forseeable future, and future versions of
290 Tahoe-LAFS will retain the ability to read and write files
291 compatible with Tahoe-LAFS v1.
292hunk ./src/allmydata/dirnode.py 26
293 from pycryptopp.cipher.aes import AES
294 from allmydata.util.dictutil import AuxValueDict
295 
296+
297+# TODO: {Deleter,MetadataSetter,Adder}.modify all start by unpacking the
298+# contents and end by repacking them. It might be better to apply them to
299+# the unpacked contents.
300+
301 class Deleter:
302     def __init__(self, node, name, must_exist=True):
303         self.node = node
304hunk ./src/allmydata/interfaces.py 429
305         """Return True if the data can be modified by *somebody* (perhaps
306         someone who has a more powerful URI than this one)."""
307 
308+    # TODO: rename to get_read_cap()
309     def get_readonly():
310         """Return another IURI instance, which represents a read-only form of
311         this one. If is_readonly() is True, this returns self."""
312hunk ./src/allmydata/test/test_web.py 702
313                              self.PUT, base, "")
314         return d
315 
316+    # TODO: version of this with a Unicode filename
317     def test_GET_FILEURL_save(self):
318hunk ./src/allmydata/test/test_web.py 704
319-        d = self.GET(self.public_url + "/foo/bar.txt?filename=bar.txt&save=true")
320-        # TODO: look at the headers, expect a Content-Disposition: attachment
321-        # header.
322-        d.addCallback(self.failUnlessIsBarDotTxt)
323+        d = self.GET(self.public_url + "/foo/bar.txt?filename=bar.txt&save=true",
324+                     return_response=True)
325+        def _got((res, statuscode, headers)):
326+            content_disposition = headers["content-disposition"][0]
327+            self.failUnless(content_disposition == 'attachment; filename="bar.txt"', content_disposition)
328+            self.failUnlessIsBarDotTxt(res)
329+        d.addCallback(_got)
330         return d
331 
332     def test_GET_FILEURL_missing(self):
333hunk ./src/allmydata/test/test_web.py 2178
334         # Fetch the welcome page.
335         d = self.GET("/")
336         def _after_get_welcome_page(res):
337-            MKDIR_BUTTON_RE=re.compile('<form action="([^"]*)" method="post".*?<input type="hidden" name="t" value="([^"]*)" /><input type="hidden" name="([^"]*)" value="([^"]*)" /><input type="submit" value="Create a directory" />', re.I)
338+            MKDIR_BUTTON_RE = re.compile(
339+                '<form action="([^"]*)" method="post".*?'
340+                '<input type="hidden" name="t" value="([^"]*)" />'
341+                '<input type="hidden" name="([^"]*)" value="([^"]*)" />'
342+                '<input type="submit" value="Create a directory" />',
343+                re.I)
344             mo = MKDIR_BUTTON_RE.search(res)
345             formaction = mo.group(1)
346             formt = mo.group(2)
347hunk ./src/allmydata/uri.py 13
348 class BadURIError(Exception):
349     pass
350 
351-# the URI shall be an ascii representation of the file. It shall contain
352-# enough information to retrieve and validate the contents. It shall be
353-# expressed in a limited character set (namely [TODO]).
354+# The URI shall be an ASCII representation of a reference to the file/directory.
355+# It shall contain enough information to retrieve and validate the contents.
356+# It shall be expressed in a limited character set (currently base32 plus ':' and
357+# capital letters, but future URIs might use a larger charset).
358+
359+# TODO:
360+#  - rename all of the *URI classes/interfaces to *Cap
361+#  - make variable and method names consistently use _uri for an URI string,
362+#    and _cap for a Cap object (decoded URI)
363+#  - remove the human_encoding methods?
364 
365 BASE32STR_128bits = '(%s{25}%s)' % (base32.BASE32CHAR, base32.BASE32CHAR_3bits)
366 BASE32STR_256bits = '(%s{51}%s)' % (base32.BASE32CHAR, base32.BASE32CHAR_1bits)
367hunk ./src/allmydata/uri.py 31
368 NUMBER='([0-9]+)'
369 NUMBER_IGNORE='(?:[0-9]+)'
370 
371-# URIs (soon to be renamed "caps") are always allowed to come with a leading
372+# "human-encoded" URIs are allowed to come with a leading
373 # 'http://127.0.0.1:(8123|3456)/uri/' that will be ignored.
374hunk ./src/allmydata/uri.py 33
375+# Note that nothing in the Tahoe code currently uses the human encoding.
376 OPTIONALHTTPLEAD=r'(?:https?://(?:[^:/]+)(?::%s)?/uri/)?' % NUMBER_IGNORE
377 
378 
379hunk ./src/allmydata/uri.py 40
380 class _BaseURI:
381     def __hash__(self):
382         return self.to_string().__hash__()
383+
384     def __eq__(self, them):
385         if isinstance(them, _BaseURI):
386             return self.to_string() == them.to_string()
387hunk ./src/allmydata/uri.py 46
388         else:
389             return False
390+
391     def __ne__(self, them):
392         if isinstance(them, _BaseURI):
393             return self.to_string() != them.to_string()
394hunk ./src/allmydata/uri.py 52
395         else:
396             return True
397+
398     def to_human_encoding(self):
399         return 'http://127.0.0.1:3456/uri/'+self.to_string()
400 
401hunk ./src/allmydata/uri.py 59
402     def get_storage_index(self):
403         return self.storage_index
404 
405+
406 class CHKFileURI(_BaseURI):
407     implements(IURI, IImmutableFileURI)
408 
409}
410
411Context:
412
413[docs: further CREDITS level-ups for Nils, Kevan, David-Sarah
414zooko@zooko.com**20100126170021
415 Ignore-this: 1e513e85cf7b7abf57f056e6d7544b38
416]
417[ftpd: clearer error message if Twisted needs a patch (by Nils Durner)
418zooko@zooko.com**20100126143411
419 Ignore-this: 440e6831ae6da5135c1edd081c93871f
420]
421[Add 'docs/performance.txt', which (for the moment) describes mutable file performance issues
422Kevan Carstensen <kevan@isnotajoke.com>**20100115204500
423 Ignore-this: ade4e500217db2509aee35aacc8c5dbf
424]
425[docs: more CREDITS for François, Kevan, and David-Sarah
426zooko@zooko.com**20100126132133
427 Ignore-this: f37d4977c13066fcac088ba98a31b02e
428]
429[tahoe_backup.py: display warnings on errors instead of stopping the whole backup. Fix #729.
430francois@ctrlaltdel.ch**20100120094249
431 Ignore-this: 7006ea4b0910b6d29af6ab4a3997a8f9
432 
433 This patch displays a warning to the user in two cases:
434   
435   1. When special files like symlinks, fifos, devices, etc. are found in the
436      local source.
437   
438   2. If files or directories are not readables by the user running the 'tahoe
439      backup' command.
440 
441 In verbose mode, the number of skipped files and directories is printed at the
442 end of the backup.
443 
444 Exit status returned by 'tahoe backup':
445 
446   - 0 everything went fine
447   - 1 the backup failed
448   - 2 files were skipped during the backup
449 
450]
451[Message saying that we couldn't find bin/tahoe should say where we looked
452david-sarah@jacaranda.org**20100116204556
453 Ignore-this: 1068576fd59ea470f1e19196315d1bb
454]
455[Change running.html to describe 'tahoe run'
456david-sarah@jacaranda.org**20100112044409
457 Ignore-this: 23ad0114643ce31b56e19bb14e011e4f
458]
459[cli: split usage strings into groups (patch by David-Sarah Hopwood)
460zooko@zooko.com**20100126043921
461 Ignore-this: 51928d266a7292b873f87f7d53c9a01e
462]
463[Add create-node CLI command, and make create-client equivalent to create-node --no-storage (fixes #760)
464david-sarah@jacaranda.org**20100116052055
465 Ignore-this: 47d08b18c69738685e13ff365738d5a
466]
467[contrib/fuse/runtests.py: Fix #888, configure settings in tahoe.cfg and don't treat warnings as failure
468francois@ctrlaltdel.ch**20100109123010
469 Ignore-this: 2590d44044acd7dfa3690c416cae945c
470 
471 Fix a few bitrotten pieces in the FUSE test script.  It now configures tahoe
472 node settings by editing tahoe.cfg which is the new supported method.
473 
474 It alos tolerate warnings issued by the mount command, the cause of these
475 warnings is the same as in #876 (contrib/fuse/runtests.py doesn't tolerate
476 deprecations warnings).
477 
478]
479[Fix webapi t=mkdir with multpart/form-data, as on the Welcome page. Closes #919.
480Brian Warner <warner@lothar.com>**20100121065052
481 Ignore-this: 1f20ea0a0f1f6d6c1e8e14f193a92c87
482]
483[Fix boodlegrid use of set_children
484david-sarah@jacaranda.org**20100126063414
485 Ignore-this: 3aa2d4836f76303b2bacecd09611f999
486]
487[Remove replace= parameter to mkdir-immutable and mkdir-with-children
488david-sarah@jacaranda.org**20100124224325
489 Ignore-this: 25207bcc946c0c43d9528718e76ba7b
490]
491[Warn about test failures due to setting FLOG* env vars
492david-sarah@jacaranda.org**20100124220629
493 Ignore-this: 1c25247ca0f0840390a1b7259a9f4a3c
494]
495[Patch to accept t=set-children as well as t=set_children
496david-sarah@jacaranda.org**20100124030020
497 Ignore-this: 2c061f12af817cdf77feeeb64098ec3a
498]
499[tahoe_add_alias.py: minor refactoring
500Brian Warner <warner@lothar.com>**20100115064220
501 Ignore-this: 29910e81ad11209c9e493d65fd2dab9b
502]
503[test_dirnode.py: reduce scope of a Client instance, suggested by Kevan.
504Brian Warner <warner@lothar.com>**20100115062713
505 Ignore-this: b35efd9e6027e43de6c6f509bfb4ccaa
506]
507[test_provisioning: STAN is not always a list. Fix by David-Sarah Hopwood.
508Brian Warner <warner@lothar.com>**20100115014632
509 Ignore-this: 9989de7f1e00907706d2b63153138219
510]
511[web/directory.py mkdir-immutable: hush pyflakes, add TODO for #903 behavior
512Brian Warner <warner@lothar.com>**20100114222804
513 Ignore-this: 717cd3b9a1c8aeee76938c9641db7356
514]
515[hush pyflakes-0.4.0 warnings: slightly less-trivial fixes. Closes #900.
516Brian Warner <warner@lothar.com>**20100114221719
517 Ignore-this: f774f4637e256ad55502659413a811a8
518 
519 This includes one fix (in test_web) which was testing the wrong thing.
520]
521[hush pyflakes-0.4.0 warnings: remove trivial unused variables. For #900.
522Brian Warner <warner@lothar.com>**20100114221529
523 Ignore-this: e96106c8f1a99fbf93306fbfe9a294cf
524]
525[tahoe add-alias/create-alias: don't corrupt non-newline-terminated alias
526Brian Warner <warner@lothar.com>**20100114210246
527 Ignore-this: 9c994792e53a85159d708760a9b1b000
528 file. Closes #741.
529]
530[change docs and --help to use "grid" instead of "virtual drive": closes #892.
531Brian Warner <warner@lothar.com>**20100114201119
532 Ignore-this: a20d4a4dcc4de4e3b404ff72d40fc29b
533 
534 Thanks to David-Sarah Hopwood for the patch.
535]
536[backupdb.txt: fix ST_CTIME reference
537Brian Warner <warner@lothar.com>**20100114194052
538 Ignore-this: 5a189c7a1181b07dd87f0a08ea31b6d3
539]
540[client.py: fix/update comments on KeyGenerator
541Brian Warner <warner@lothar.com>**20100113004226
542 Ignore-this: 2208adbb3fd6a911c9f44e814583cabd
543]
544[Clean up log.err calls, for one of the issues in #889.
545Brian Warner <warner@lothar.com>**20100112013343
546 Ignore-this: f58455ce15f1fda647c5fb25d234d2db
547 
548 allmydata.util.log.err() either takes a Failure as the first positional
549 argument, or takes no positional arguments and must be invoked in an
550 exception handler. Fixed its signature to match both foolscap.logging.log.err
551 and twisted.python.log.err . Included a brief unit test.
552]
553[tidy up DeadReferenceError handling, ignore them in add_lease calls
554Brian Warner <warner@lothar.com>**20100112000723
555 Ignore-this: 72f1444e826fd0b9db6d318f89603c38
556 
557 Stop checking separately for ConnectionDone/ConnectionLost, since those have
558 been folded into DeadReferenceError since foolscap-0.3.1 . Write
559 rrefutil.trap_deadref() in terms of rrefutil.trap_and_discard() to improve
560 code coverage.
561]
562[NEWS: improve "tahoe backup" notes, mention first-backup-after-upgrade duration
563Brian Warner <warner@lothar.com>**20100111190132
564 Ignore-this: 10347c590b3375964579ba6c2b0edb4f
565 
566 Thanks to Francois Deppierraz for the suggestion.
567]
568[test_repairer: add (commented-out) test_each_byte, to see exactly what the
569Brian Warner <warner@lothar.com>**20100110203552
570 Ignore-this: 8e84277d5304752edeff052b97821815
571 Verifier misses
572 
573 The results (described in #819) match our expectations: it misses corruption
574 in unused share fields and in most container fields (which are only visible
575 to the storage server, not the client). 1265 bytes of a 2753 byte
576 share (hosting a 56-byte file with an artifically small segment size) are
577 unused, mostly in the unused tail of the overallocated UEB space (765 bytes),
578 and the allocated-but-unwritten plaintext_hash_tree (480 bytes).
579]
580[repairer: fix some wrong offsets in the randomized verifier tests, debugged by Brian
581zooko@zooko.com**20100110203721
582 Ignore-this: 20604a609db8706555578612c1c12feb
583 fixes #819
584]
585[test_repairer: fix colliding basedir names, which caused test inconsistencies
586Brian Warner <warner@lothar.com>**20100110084619
587 Ignore-this: b1d56dd27e6ab99a7730f74ba10abd23
588]
589[repairer: add deterministic test for #819, mark as TODO
590zooko@zooko.com**20100110013619
591 Ignore-this: 4cb8bb30b25246de58ed2b96fa447d68
592]
593[contrib/fuse/runtests.py: Tolerate the tahoe CLI returning deprecation warnings
594francois@ctrlaltdel.ch**20100109175946
595 Ignore-this: 419c354d9f2f6eaec03deb9b83752aee
596 
597 Depending on the versions of external libraries such as Twisted of Foolscap,
598 the tahoe CLI can display deprecation warnings on stdout.  The tests should
599 not interpret those warnings as a failure if the node is in fact correctly
600 started.
601   
602 See http://allmydata.org/trac/tahoe/ticket/859 for an example of deprecation
603 warnings.
604 
605 fixes #876
606]
607[contrib: fix fuse_impl_c to use new Python API
608zooko@zooko.com**20100109174956
609 Ignore-this: 51ca1ec7c2a92a0862e9b99e52542179
610 original patch by Thomas Delaet, fixed by François, reviewed by Brian, committed by me
611]
612[docs: CREDITS: add David-Sarah to the CREDITS file
613zooko@zooko.com**20100109060435
614 Ignore-this: 896062396ad85f9d2d4806762632f25a
615]
616[mutable/publish: don't loop() right away upon DeadReferenceError. Closes #877
617Brian Warner <warner@lothar.com>**20100102220841
618 Ignore-this: b200e707b3f13aa8251981362b8a3e61
619 
620 The bug was that a disconnected server could cause us to re-enter the initial
621 loop() call, sending multiple queries to a single server, provoking an
622 incorrect UCWE. To fix it, stall the loop() with an eventual.fireEventually()
623]
624[immutable/checker.py: oops, forgot some imports. Also hush pyflakes.
625Brian Warner <warner@lothar.com>**20091229233909
626 Ignore-this: 4d61bd3f8113015a4773fd4768176e51
627]
628[mutable repair: return successful=False when numshares<k (thus repair fails),
629Brian Warner <warner@lothar.com>**20091229233746
630 Ignore-this: d881c3275ff8c8bee42f6a80ca48441e
631 instead of weird errors. Closes #874 and #786.
632 
633 Previously, if the file had 0 shares, this would raise TypeError as it tried
634 to call download_version(None). If the file had some shares but fewer than
635 'k', it would incorrectly raise MustForceRepairError.
636 
637 Added get_successful() to the IRepairResults API, to give repair() a place to
638 report non-code-bug problems like this.
639]
640[node.py/interfaces.py: minor docs fixes
641Brian Warner <warner@lothar.com>**20091229230409
642 Ignore-this: c86ad6342ef0f95d50639b4f99cd4ddf
643]
644[NEWS: fix 1.4.1 announcement w.r.t. add-lease behavior in older releases
645Brian Warner <warner@lothar.com>**20091229230310
646 Ignore-this: bbbbb9c961f3bbcc6e5dbe0b1594822
647]
648[checker: don't let failures in add-lease affect checker results. Closes #875.
649Brian Warner <warner@lothar.com>**20091229230108
650 Ignore-this: ef1a367b93e4d01298c2b1e6ca59c492
651 
652 Mutable servermap updates and the immutable checker, when run with
653 add_lease=True, send both the do-you-have-block and add-lease commands in
654 parallel, to avoid an extra round trip time. Many older servers have problems
655 with add-lease and raise various exceptions, which don't generally matter.
656 The client-side code was catching+ignoring some of them, but unrecognized
657 exceptions were passed through to the DYHB code, concealing the DYHB results
658 from the checker, making it think the server had no shares.
659 
660 The fix is to separate the code paths. Both commands are sent at the same
661 time, but the errback path from add-lease is handled separately. Known
662 exceptions are ignored, the others (both unknown-remote and all-local) are
663 logged (log.WEIRD, which will trigger an Incident), but neither will affect
664 the DYHB results.
665 
666 The add-lease message is sent first, and we know that the server handles them
667 synchronously. So when the checker is done, we can be sure that all the
668 add-lease messages have been retired. This makes life easier for unit tests.
669]
670[test_cli: verify fix for "tahoe get" not creating empty file on error (#121)
671Brian Warner <warner@lothar.com>**20091227235444
672 Ignore-this: 6444d52413b68eb7c11bc3dfdc69c55f
673]
674[addendum to "Fix 'tahoe ls' on files (#771)"
675Brian Warner <warner@lothar.com>**20091227232149
676 Ignore-this: 6dd5e25f8072a3153ba200b7fdd49491
677 
678 tahoe_ls.py: tolerate missing metadata
679 web/filenode.py: minor cleanups
680 test_cli.py: test 'tahoe ls FILECAP'
681]
682[Fix 'tahoe ls' on files (#771). Patch adapted from Kevan Carstensen.
683Brian Warner <warner@lothar.com>**20091227225443
684 Ignore-this: 8bf8c7b1cd14ea4b0ebd453434f4fe07
685 
686 web/filenode.py: also serve edge metadata when using t=json on a
687                  DIRCAP/childname object.
688 tahoe_ls.py: list file objects as if we were listing one-entry directories.
689              Show edge metadata if we have it, which will be true when doing
690              'tahoe ls DIRCAP/filename' and false when doing 'tahoe ls
691              FILECAP'
692]
693[tahoe_get: don't create the output file on error. Closes #121.
694Brian Warner <warner@lothar.com>**20091227220404
695 Ignore-this: 58d5e793a77ec6e87d9394ade074b926
696]
697[webapi: don't accept zero-length childnames during traversal. Closes #358, #676.
698Brian Warner <warner@lothar.com>**20091227201043
699 Ignore-this: a9119dec89e1c7741f2289b0cad6497b
700 
701 This forbids operations that would implicitly create a directory with a
702 zero-length (empty string) name, like what you'd get if you did "tahoe put
703 local /oops/blah" (#358) or "POST /uri/CAP//?t=mkdir" (#676). The error
704 message is fairly friendly too.
705 
706 Also added code to "tahoe put" to catch this error beforehand and suggest the
707 correct syntax (i.e. without the leading slash).
708]
709[CLI: send 'Accept:' header to ask for text/plain tracebacks. Closes #646.
710Brian Warner <warner@lothar.com>**20091227195828
711 Ignore-this: 44c258d4d4c7dac0ed58adb22f73331
712 
713 The webapi has been looking for an Accept header since 1.4.0, but it treats a
714 missing header as equal to */* (to honor RFC2616). This change finally
715 modifies our CLI tools to ask for "text/plain, application/octet-stream",
716 which seems roughly correct (we either want a plain-text traceback or error
717 message, or an uninterpreted chunk of binary data to save to disk). Some day
718 we'll figure out how JSON fits into this scheme.
719]
720[Makefile: upload-tarballs: switch from xfer-client to flappclient, closes #350
721Brian Warner <warner@lothar.com>**20091227163703
722 Ignore-this: 3beeecdf2ad9c2438ab57f0e33dcb357
723 
724 I've also set up a new flappserver on source@allmydata.org to receive the
725 tarballs. We still need to replace the gutsy buildslave (which is where the
726 tarballs used to be generated+uploaded) and give it the new FURL.
727]
728[misc/ringsim.py: make it deterministic, more detail about grid-is-full behavior
729Brian Warner <warner@lothar.com>**20091227024832
730 Ignore-this: a691cc763fb2e98a4ce1767c36e8e73f
731]
732[misc/ringsim.py: tool to discuss #302
733Brian Warner <warner@lothar.com>**20091226060339
734 Ignore-this: fc171369b8f0d97afeeb8213e29d10ed
735]
736[docs: fix helper.txt to describe new config style
737zooko@zooko.com**20091224223522
738 Ignore-this: 102e7692dc414a4b466307f7d78601fe
739]
740[docs/stats.txt: add TOC, notes about controlling gatherer's listening port
741Brian Warner <warner@lothar.com>**20091224202133
742 Ignore-this: 8eef63b0e18db5aa8249c2eafde02c05
743 
744 Thanks to Jody Harris for the suggestions.
745]
746[Add docs/stats.py, explaining Tahoe stats, the gatherer, and the munin plugins.
747Brian Warner <warner@lothar.com>**20091223052400
748 Ignore-this: 7c9eeb6e5644eceda98b59a67730ccd5
749]
750[more #859: avoid deprecation warning for unit tests too, hush pyflakes
751Brian Warner <warner@lothar.com>**20091215000147
752 Ignore-this: 193622e24d31077da825a11ed2325fd3
753 
754 * factor maybe-import-sha logic into util.hashutil
755]
756[use hashlib module if available, thus avoiding a DeprecationWarning for importing the old sha module; fixes #859
757zooko@zooko.com**20091214212703
758 Ignore-this: 8d0f230a4bf8581dbc1b07389d76029c
759]
760[docs: reflow architecture.txt to 78-char lines
761zooko@zooko.com**20091208232943
762 Ignore-this: 88f55166415f15192e39407815141f77
763]
764[docs: update the about.html a little
765zooko@zooko.com**20091208212737
766 Ignore-this: 3fe2d9653c6de0727d3e82bd70f2a8ed
767]
768[docs: remove obsolete doc file "codemap.txt"
769zooko@zooko.com**20091113163033
770 Ignore-this: 16bc21a1835546e71d1b344c06c61ebb
771 I started to update this to reflect the current codebase, but then I thought (a) nobody seemed to notice that it hasn't been updated since December 2007, and (b) it will just bit-rot again, so I'm removing it.
772]
773[mutable/retrieve.py: stop reaching into private MutableFileNode attributes
774Brian Warner <warner@lothar.com>**20091208172921
775 Ignore-this: 61e548798c1105aed66a792bf26ceef7
776]
777[mutable/servermap.py: stop reaching into private MutableFileNode attributes
778Brian Warner <warner@lothar.com>**20091208172608
779 Ignore-this: b40a6b62f623f9285ad96fda139c2ef2
780]
781[mutable/servermap.py: oops, query N+e servers in MODE_WRITE, not k+e
782Brian Warner <warner@lothar.com>**20091208171156
783 Ignore-this: 3497f4ab70dae906759007c3cfa43bc
784 
785 under normal conditions, this wouldn't cause any problems, but if the shares
786 are really sparse (perhaps because new servers were added), then
787 file-modifies might stop looking too early and leave old shares in place
788]
789[control.py: fix speedtest: use download_best_version (not read) on mutable nodes
790Brian Warner <warner@lothar.com>**20091207060512
791 Ignore-this: 7125eabfe74837e05f9291dd6414f917
792]
793[FTP-and-SFTP.txt: fix ssh-keygen pointer
794Brian Warner <warner@lothar.com>**20091207052803
795 Ignore-this: bc2a70ee8c58ec314e79c1262ccb22f7
796]
797[setup: ignore _darcs in the "test-clean" test and make the "clean" step remove all .egg's in the root dir
798zooko@zooko.com**20091206184835
799 Ignore-this: 6066bd160f0db36d7bf60aba405558d2
800]
801[remove MutableFileNode.download(), prefer download_best_version() instead
802Brian Warner <warner@lothar.com>**20091201225438
803 Ignore-this: 5733eb373a902063e09fd52cc858dec0
804]
805[Simplify immutable download API: use just filenode.read(consumer, offset, size)
806Brian Warner <warner@lothar.com>**20091201225330
807 Ignore-this: bdedfb488ac23738bf52ae6d4ab3a3fb
808 
809 * remove Downloader.download_to_data/download_to_filename/download_to_filehandle
810 * remove download.Data/FileName/FileHandle targets
811 * remove filenode.download/download_to_data/download_to_filename methods
812 * leave Downloader.download (the whole Downloader will go away eventually)
813 * add util.consumer.MemoryConsumer/download_to_data, for convenience
814   (this is mostly used by unit tests, but it gets used by enough non-test
815    code to warrant putting it in allmydata.util)
816 * update tests
817 * removes about 180 lines of code. Yay negative code days!
818 
819 Overall plan is to rewrite immutable/download.py and leave filenode.read() as
820 the sole read-side API.
821]
822[server.py: undo my bogus 'correction' of David-Sarah's comment fix
823Brian Warner <warner@lothar.com>**20091201024607
824 Ignore-this: ff4bb58f6a9e045b900ac3a89d6f506a
825 
826 and move it to a better line
827]
828[Implement more coherent behavior when copying with dircaps/filecaps (closes #761). Patch by Kevan Carstensen.
829"Brian Warner <warner@lothar.com>"**20091130211009]
830[storage.py: update comment
831"Brian Warner <warner@lothar.com>"**20091130195913]
832[storage server: detect disk space usage on Windows too (fixes #637)
833david-sarah@jacaranda.org**20091121055644
834 Ignore-this: 20fb30498174ce997befac7701fab056
835]
836[make status of finished operations consistently "Finished"
837david-sarah@jacaranda.org**20091121061543
838 Ignore-this: 97d483e8536ccfc2934549ceff7055a3
839]
840[NEWS: update with all user-visible changes since the last release
841Brian Warner <warner@lothar.com>**20091127224217
842 Ignore-this: 741da6cd928e939fb6d21a61ea3daf0b
843]
844[update "tahoe backup" docs, and webapi.txt's mkdir-with-children
845Brian Warner <warner@lothar.com>**20091127055900
846 Ignore-this: defac1fb9a2335b0af3ef9dbbcc67b7e
847]
848[Add dirnodes to backupdb and "tahoe backup", closes #606.
849Brian Warner <warner@lothar.com>**20091126234257
850 Ignore-this: fa88796fcad1763c6a2bf81f56103223
851 
852 * backups now share dirnodes with any previous backup, in any location,
853   so renames and moves are handled very efficiently
854 * "tahoe backup" no longer bothers reading the previous snapshot
855 * if you switch grids, you should delete ~/.tahoe/private/backupdb.sqlite,
856   to force new uploads of all files and directories
857]
858[webapi: fix t=check for DIR2-LIT (i.e. empty immutable directories)
859Brian Warner <warner@lothar.com>**20091126232731
860 Ignore-this: 8513c890525c69c1eca0e80d53a231f8
861]
862[PipelineError: fix str() on python2.4 . Closes #842.
863Brian Warner <warner@lothar.com>**20091124212512
864 Ignore-this: e62c92ea9ede2ab7d11fe63f43b9c942
865]
866[test_uri.py: s/NewDirnode/Dirnode/ , now that they aren't "new" anymore
867Brian Warner <warner@lothar.com>**20091120075553
868 Ignore-this: 61c8ef5e45a9d966873a610d8349b830
869]
870[interface name cleanups: IFileNode, IImmutableFileNode, IMutableFileNode
871Brian Warner <warner@lothar.com>**20091120075255
872 Ignore-this: e3d193c229e2463e1d0b0c92306de27f
873 
874 The proper hierarchy is:
875  IFilesystemNode
876  +IFileNode
877  ++IMutableFileNode
878  ++IImmutableFileNode
879  +IDirectoryNode
880 
881 Also expand test_client.py (NodeMaker) to hit all IFilesystemNode types.
882]
883[class name cleanups: s/FileNode/ImmutableFileNode/
884Brian Warner <warner@lothar.com>**20091120072239
885 Ignore-this: 4b3218f2d0e585c62827e14ad8ed8ac1
886 
887 also fix test/bench_dirnode.py for recent dirnode changes
888]
889[Use DIR-IMM and t=mkdir-immutable for "tahoe backup", for #828
890Brian Warner <warner@lothar.com>**20091118192813
891 Ignore-this: a4720529c9bc6bc8b22a3d3265925491
892]
893[web/directory.py: use "DIR-IMM" to describe immutable directories, not DIR-RO
894Brian Warner <warner@lothar.com>**20091118191832
895 Ignore-this: aceafd6ab4bf1cc0c2a719ef7319ac03
896]
897[web/info.py: hush pyflakes
898Brian Warner <warner@lothar.com>**20091118191736
899 Ignore-this: edc5f128a2b8095fb20686a75747c8
900]
901[make get_size/get_current_size consistent for all IFilesystemNode classes
902Brian Warner <warner@lothar.com>**20091118191624
903 Ignore-this: bd3449cf96e4827abaaf962672c1665a
904 
905 * stop caching most_recent_size in dirnode, rely upon backing filenode for it
906 * start caching most_recent_size in MutableFileNode
907 * return None when you don't know, not "?"
908 * only render None as "?" in the web "more info" page
909 * add get_size/get_current_size to UnknownNode
910]
911[ImmutableDirectoryURIVerifier: fix verifycap handling
912Brian Warner <warner@lothar.com>**20091118164238
913 Ignore-this: 6bba5c717b54352262eabca6e805d590
914]
915[Add t=mkdir-immutable to the webapi. Closes #607.
916Brian Warner <warner@lothar.com>**20091118070900
917 Ignore-this: 311e5fab9a5f28b9e8a28d3d08f3c0d
918 
919 * change t=mkdir-with-children to not use multipart/form encoding. Instead,
920   the request body is all JSON. t=mkdir-immutable uses this format too.
921 * make nodemaker.create_immutable_dirnode() get convergence from SecretHolder,
922   but let callers override it
923 * raise NotDeepImmutableError instead of using assert()
924 * add mutable= argument to DirectoryNode.create_subdirectory(), default True
925]
926[move convergence secret into SecretHolder, next to lease secret
927Brian Warner <warner@lothar.com>**20091118015444
928 Ignore-this: 312f85978a339f2d04deb5bcb8f511bc
929]
930[nodemaker: implement immutable directories (internal interface), for #607
931Brian Warner <warner@lothar.com>**20091112002233
932 Ignore-this: d09fccf41813fdf7e0db177ed9e5e130
933 
934 * nodemaker.create_from_cap() now handles DIR2-CHK and DIR2-LIT
935 * client.create_immutable_dirnode() is used to create them
936 * no webapi yet
937]
938[stop using IURI()/etc as an adapter
939Brian Warner <warner@lothar.com>**20091111224542
940 Ignore-this: 9611da7ea6a4696de2a3b8c08776e6e0
941]
942[clean up uri-vs-cap terminology, emphasize cap instances instead of URI strings
943Brian Warner <warner@lothar.com>**20091111222619
944 Ignore-this: 93626385f6e7f039ada71f54feefe267
945 
946  * "cap" means a python instance which encapsulates a filecap/dircap (uri.py)
947  * "uri" means a string with a "URI:" prefix
948  * FileNode instances are created with (and retain) a cap instance, and
949    generate uri strings on demand
950  * .get_cap/get_readcap/get_verifycap/get_repaircap return cap instances
951  * .get_uri/get_readonly_uri return uri strings
952 
953 * add filenode.download_to_filename() for control.py, should find a better way
954 * use MutableFileNode.init_from_cap, not .init_from_uri
955 * directory URI instances: use get_filenode_cap, not get_filenode_uri
956 * update/cleanup bench_dirnode.py to match, add Makefile target to run it
957]
958[add parser for immutable directory caps: DIR2-CHK, DIR2-LIT, DIR2-CHK-Verifier
959Brian Warner <warner@lothar.com>**20091104181351
960 Ignore-this: 854398cc7a75bada57fa97c367b67518
961]
962[wui: s/TahoeLAFS/Tahoe-LAFS/
963zooko@zooko.com**20091029035050
964 Ignore-this: 901e64cd862e492ed3132bd298583c26
965]
966[tests: bump up the timeout on test_repairer to see if 120 seconds was too short for François's ARM box to do the test even when it was doing it right.
967zooko@zooko.com**20091027224800
968 Ignore-this: 95e93dc2e018b9948253c2045d506f56
969]
970[dirnode.pack_children(): add deep_immutable= argument
971Brian Warner <warner@lothar.com>**20091026162809
972 Ignore-this: d5a2371e47662c4bc6eff273e8181b00
973 
974 This will be used by DIR2:CHK to enforce the deep-immutability requirement.
975]
976[webapi: use t=mkdir-with-children instead of a children= arg to t=mkdir .
977Brian Warner <warner@lothar.com>**20091026011321
978 Ignore-this: 769cab30b6ab50db95000b6c5a524916
979 
980 This is safer: in the earlier API, an old webapi server would silently ignore
981 the initial children, and clients trying to set them would have to fetch the
982 newly-created directory to discover the incompatibility. In the new API,
983 clients using t=mkdir-with-children against an old webapi server will get a
984 clear error.
985]
986[nodemaker.create_new_mutable_directory: pack_children() in initial_contents=
987Brian Warner <warner@lothar.com>**20091020005118
988 Ignore-this: bd43c4eefe06fd32b7492bcb0a55d07e
989 instead of creating an empty file and then adding the children later.
990 
991 This should speed up mkdir(initial_children) considerably, removing two
992 roundtrips and an entire read-modify-write cycle, probably bringing it down
993 to a single roundtrip. A quick test (against the volunteergrid) suggests a
994 30% speedup.
995 
996 test_dirnode: add new tests to enforce the restrictions that interfaces.py
997 claims for create_new_mutable_directory(): no UnknownNodes, metadata dicts
998]
999[test_dirnode.py: add tests of initial_children= args to client.create_dirnode
1000Brian Warner <warner@lothar.com>**20091017194159
1001 Ignore-this: 2e2da28323a4d5d815466387914abc1b
1002 and nodemaker.create_new_mutable_directory
1003]
1004[update many dirnode interfaces to accept dict-of-nodes instead of dict-of-caps
1005Brian Warner <warner@lothar.com>**20091017192829
1006 Ignore-this: b35472285143862a856bf4b361d692f0
1007 
1008 interfaces.py: define INodeMaker, document argument values, change
1009                create_new_mutable_directory() to take dict-of-nodes. Change
1010                dirnode.set_nodes() and dirnode.create_subdirectory() too.
1011 nodemaker.py: use INodeMaker, update create_new_mutable_directory()
1012 client.py: have create_dirnode() delegate initial_children= to nodemaker
1013 dirnode.py (Adder): take dict-of-nodes instead of list-of-nodes, which
1014                     updates set_nodes() and create_subdirectory()
1015 web/common.py (convert_initial_children_json): create dict-of-nodes
1016 web/directory.py: same
1017 web/unlinked.py: same
1018 test_dirnode.py: update tests to match
1019]
1020[dirnode.py: move pack_children() out to a function, for eventual use by others
1021Brian Warner <warner@lothar.com>**20091017180707
1022 Ignore-this: 6a823fb61f2c180fd38d6742d3196a7a
1023]
1024[move dirnode.CachingDict to dictutil.AuxValueDict, generalize method names,
1025Brian Warner <warner@lothar.com>**20091017180005
1026 Ignore-this: b086933cf429df0fcea16a308d2640dd
1027 improve tests. Let dirnode _pack_children accept either dict or AuxValueDict.
1028]
1029[test/common.py: update FakeMutableFileNode to new contents= callable scheme
1030Brian Warner <warner@lothar.com>**20091013052154
1031 Ignore-this: 62f00a76454a2190d1c8641c5993632f
1032]
1033[The initial_children= argument to nodemaker.create_new_mutable_directory is
1034Brian Warner <warner@lothar.com>**20091013031922
1035 Ignore-this: 72e45317c21f9eb9ec3bd79bd4311f48
1036 now enabled.
1037]
1038[client.create_mutable_file(contents=) now accepts a callable, which is
1039Brian Warner <warner@lothar.com>**20091013031232
1040 Ignore-this: 3c89d2f50c1e652b83f20bd3f4f27c4b
1041 invoked with the new MutableFileNode and is supposed to return the initial
1042 contents. This can be used by e.g. a new dirnode which needs the filenode's
1043 writekey to encrypt its initial children.
1044 
1045 create_mutable_file() still accepts a bytestring too, or None for an empty
1046 file.
1047]
1048[webapi: t=mkdir now accepts initial children, using the same JSON that t=json
1049Brian Warner <warner@lothar.com>**20091013023444
1050 Ignore-this: 574a46ed46af4251abf8c9580fd31ef7
1051 emits.
1052 
1053 client.create_dirnode(initial_children=) now works.
1054]
1055[replace dirnode.create_empty_directory() with create_subdirectory(), which
1056Brian Warner <warner@lothar.com>**20091013021520
1057 Ignore-this: 6b57cb51bcfcc6058d0df569fdc8a9cf
1058 takes an initial_children= argument
1059]
1060[dirnode.set_children: change return value: fire with self instead of None
1061Brian Warner <warner@lothar.com>**20091013015026
1062 Ignore-this: f1d14e67e084e4b2a4e25fa849b0e753
1063]
1064[dirnode.set_nodes: change return value: fire with self instead of None
1065Brian Warner <warner@lothar.com>**20091013014546
1066 Ignore-this: b75b3829fb53f7399693f1c1a39aacae
1067]
1068[dirnode.set_children: take a dict, not a list
1069Brian Warner <warner@lothar.com>**20091013002440
1070 Ignore-this: 540ce72ce2727ee053afaae1ff124e21
1071]
1072[dirnode.set_uri/set_children: change signature to take writecap+readcap
1073Brian Warner <warner@lothar.com>**20091012235126
1074 Ignore-this: 5df617b2d379a51c79148a857e6026b1
1075 instead of a single cap. The webapi t=set_children call benefits too.
1076]
1077[replace Client.create_empty_dirnode() with create_dirnode(), in anticipation
1078Brian Warner <warner@lothar.com>**20091012224506
1079 Ignore-this: cbdaa4266ecb3c6496ffceab4f95709d
1080 of adding initial_children= argument.
1081 
1082 Includes stubbed-out initial_children= support.
1083]
1084[test_web.py: use a less-fake client, making test harness smaller
1085Brian Warner <warner@lothar.com>**20091012222808
1086 Ignore-this: 29e95147f8c94282885c65b411d100bb
1087]
1088[webapi.txt: document t=set_children, other small edits
1089Brian Warner <warner@lothar.com>**20091009200446
1090 Ignore-this: 4d7e76b04a7b8eaa0a981879f778ea5d
1091]
1092[Verifier: check the full cryptext-hash tree on each share. Removed .todos
1093Brian Warner <warner@lothar.com>**20091005221849
1094 Ignore-this: 6fb039c5584812017d91725e687323a5
1095 from the last few test_repairer tests that were waiting on this.
1096]
1097[Verifier: check the full block-hash-tree on each share
1098Brian Warner <warner@lothar.com>**20091005214844
1099 Ignore-this: 3f7ccf6d253f32340f1bf1da27803eee
1100 
1101 Removed the .todo from two test_repairer tests that check this. The only
1102 remaining .todos are on the three crypttext-hash-tree tests.
1103]
1104[Verifier: check the full share-hash chain on each share
1105Brian Warner <warner@lothar.com>**20091005213443
1106 Ignore-this: 3d30111904158bec06a4eac22fd39d17
1107 
1108 Removed the .todo from two test_repairer tests that check this.
1109]
1110[test_repairer: rename Verifier test cases to be more precise and less verbose
1111Brian Warner <warner@lothar.com>**20091005201115
1112 Ignore-this: 64be7094e33338c7c2aea9387e138771
1113]
1114[immutable/checker.py: rearrange code a little bit, make it easier to follow
1115Brian Warner <warner@lothar.com>**20091005200252
1116 Ignore-this: 91cc303fab66faf717433a709f785fb5
1117]
1118[test/common.py: wrap docstrings to 80cols so I can read them more easily
1119Brian Warner <warner@lothar.com>**20091005200143
1120 Ignore-this: b180a3a0235cbe309c87bd5e873cbbb3
1121]
1122[immutable/download.py: wrap to 80cols, no functional changes
1123Brian Warner <warner@lothar.com>**20091005192542
1124 Ignore-this: 6b05fe3dc6d78832323e708b9e6a1fe
1125]
1126[CHK-hashes.svg: cross out plaintext hashes, since we don't include
1127Brian Warner <warner@lothar.com>**20091005010803
1128 Ignore-this: bea2e953b65ec7359363aa20de8cb603
1129 them (until we finish #453)
1130]
1131[docs: a few licensing clarifications requested by Ubuntu
1132zooko@zooko.com**20090927033226
1133 Ignore-this: 749fc8c9aeb6dc643669854a3e81baa7
1134]
1135[setup: remove binary WinFUSE modules
1136zooko@zooko.com**20090924211436
1137 Ignore-this: 8aefc571d2ae22b9405fc650f2c2062
1138 I would prefer to have just source code, or indications of what 3rd-party packages are required, under revision control, and have the build process generate o
1139 r acquire the binaries as needed.  Also, having these in our release tarballs is interfering with getting Tahoe-LAFS uploaded into Ubuntu Karmic.  (Technicall
1140 y, they would accept binary modules as long as they came with the accompanying source so that they could satisfy their obligations under GPL2+ and TGPPL1+, bu
1141 t it is easier for now to remove the binaries from the source tree.)
1142 In this case, the binaries are from the tahoe-w32-client project: http://allmydata.org/trac/tahoe-w32-client , from which you can also get the source.
1143]
1144[setup: remove binary _fusemodule.so 's
1145zooko@zooko.com**20090924211130
1146 Ignore-this: 74487bbe27d280762ac5dd5f51e24186
1147 I would prefer to have just source code, or indications of what 3rd-party packages are required, under revision control, and have the build process generate or acquire the binaries as needed.  Also, having these in our release tarballs is interfering with getting Tahoe-LAFS uploaded into Ubuntu Karmic.  (Technically, they would accept binary modules as long as they came with the accompanying source so that they could satisfy their obligations under GPL2+ and TGPPL1+, but it is easier for now to remove the binaries from the source tree.)
1148 In this case, these modules come from the MacFUSE project: http://code.google.com/p/macfuse/
1149]
1150[doc: add a copy of LGPL2 for documentation purposes for ubuntu
1151zooko@zooko.com**20090924054218
1152 Ignore-this: 6a073b48678a7c84dc4fbcef9292ab5b
1153]
1154[setup: remove a convenience copy of figleaf, to ease inclusion into Ubuntu Karmic Koala
1155zooko@zooko.com**20090924053215
1156 Ignore-this: a0b0c990d6e2ee65c53a24391365ac8d
1157 We need to carefully document the licence of figleaf in order to get Tahoe-LAFS into Ubuntu Karmic Koala.  However, figleaf isn't really a part of Tahoe-LAFS per se -- this is just a "convenience copy" of a development tool.  The quickest way to make Tahoe-LAFS acceptable for Karmic then, is to remove figleaf from the Tahoe-LAFS tarball itself.  People who want to run figleaf on Tahoe-LAFS (as everyone should want) can install figleaf themselves.  I haven't tested this -- there may be incompatibilities between upstream figleaf and the copy that we had here...
1158]
1159[setup: shebang for misc/build-deb.py to fail quickly
1160zooko@zooko.com**20090819135626
1161 Ignore-this: 5a1b893234d2d0bb7b7346e84b0a6b4d
1162 Without this patch, when I ran "chmod +x ./misc/build-deb.py && ./misc/build-deb.py" then it hung indefinitely.  (I wonder what it was doing.)
1163]
1164[docs: Shawn Willden grants permission for his contributions under GPL2+|TGPPL1+
1165zooko@zooko.com**20090921164651
1166 Ignore-this: ef1912010d07ff2ffd9678e7abfd0d57
1167]
1168[docs: Csaba Henk granted permission to license fuse.py under the same terms as Tahoe-LAFS itself
1169zooko@zooko.com**20090921154659
1170 Ignore-this: c61ba48dcb7206a89a57ca18a0450c53
1171]
1172[setup: mark setup.py as having utf-8 encoding in it
1173zooko@zooko.com**20090920180343
1174 Ignore-this: 9d3850733700a44ba7291e9c5e36bb91
1175]
1176[doc: licensing cleanups
1177zooko@zooko.com**20090920171631
1178 Ignore-this: 7654f2854bf3c13e6f4d4597633a6630
1179 Use nice utf-8 © instead of "(c)". Remove licensing statements on utility modules that have been assigned to allmydata.com by their original authors. (Nattraverso was not assigned to allmydata.com -- it was LGPL'ed -- but I checked and src/allmydata/util/iputil.py was completely rewritten and doesn't contain any line of code from nattraverso.)  Add notes to misc/debian/copyright about licensing on files that aren't just allmydata.com-licensed.
1180]
1181[build-deb.py: run darcsver early, otherwise we get the wrong version later on
1182Brian Warner <warner@lothar.com>**20090918033620
1183 Ignore-this: 6635c5b85e84f8aed0d8390490c5392a
1184]
1185[new approach for debian packaging, sharing pieces across distributions. Still experimental, still only works for sid.
1186warner@lothar.com**20090818190527
1187 Ignore-this: a75eb63db9106b3269badbfcdd7f5ce1
1188]
1189[new experimental deb-packaging rules. Only works for sid so far.
1190Brian Warner <warner@lothar.com>**20090818014052
1191 Ignore-this: 3a26ad188668098f8f3cc10a7c0c2f27
1192]
1193[setup.py: read _version.py and pass to setup(version=), so more commands work
1194Brian Warner <warner@lothar.com>**20090818010057
1195 Ignore-this: b290eb50216938e19f72db211f82147e
1196 like "setup.py --version" and "setup.py --fullname"
1197]
1198[test/check_speed.py: fix shbang line
1199Brian Warner <warner@lothar.com>**20090818005948
1200 Ignore-this: 7f3a37caf349c4c4de704d0feb561f8d
1201]
1202[setup: remove bundled version of darcsver-1.2.1
1203zooko@zooko.com**20090816233432
1204 Ignore-this: 5357f26d2803db2d39159125dddb963a
1205 That version of darcsver emits a scary error message when the darcs executable or the _darcs subdirectory is not found.
1206 This error is hidden (unless the --loud option is passed) in darcsver >= 1.3.1.
1207 Fixes #788.
1208]
1209[de-Service-ify Helper, pass in storage_broker and secret_holder directly.
1210Brian Warner <warner@lothar.com>**20090815201737
1211 Ignore-this: 86b8ac0f90f77a1036cd604dd1304d8b
1212 This makes it more obvious that the Helper currently generates leases with
1213 the Helper's own secrets, rather than getting values from the client, which
1214 is arguably a bug that will likely be resolved with the Accounting project.
1215]
1216[immutable.Downloader: pass StorageBroker to constructor, stop being a Service
1217Brian Warner <warner@lothar.com>**20090815192543
1218 Ignore-this: af5ab12dbf75377640a670c689838479
1219 child of the client, access with client.downloader instead of
1220 client.getServiceNamed("downloader"). The single "Downloader" instance is
1221 scheduled for demolition anyways, to be replaced by individual
1222 filenode.download calls.
1223]
1224[tests: double the timeout on test_runner.RunNode.test_introducer since feisty hit a timeout
1225zooko@zooko.com**20090815160512
1226 Ignore-this: ca7358bce4bdabe8eea75dedc39c0e67
1227 I'm not sure if this is an actual timing issue (feisty is running on an overloaded VM if I recall correctly), or it there is a deeper bug.
1228]
1229[stop making History be a Service, it wasn't necessary
1230Brian Warner <warner@lothar.com>**20090815114415
1231 Ignore-this: b60449231557f1934a751c7effa93cfe
1232]
1233[Overhaul IFilesystemNode handling, to simplify tests and use POLA internally.
1234Brian Warner <warner@lothar.com>**20090815112846
1235 Ignore-this: 1db1b9c149a60a310228aba04c5c8e5f
1236 
1237 * stop using IURI as an adapter
1238 * pass cap strings around instead of URI instances
1239 * move filenode/dirnode creation duties from Client to new NodeMaker class
1240 * move other Client duties to KeyGenerator, SecretHolder, History classes
1241 * stop passing Client reference to dirnode/filenode constructors
1242   - pass less-powerful references instead, like StorageBroker or Uploader
1243 * always create DirectoryNodes by wrapping a filenode (mutable for now)
1244 * remove some specialized mock classes from unit tests
1245 
1246 Detailed list of changes (done one at a time, then merged together)
1247 
1248 always pass a string to create_node_from_uri(), not an IURI instance
1249 always pass a string to IFilesystemNode constructors, not an IURI instance
1250 stop using IURI() as an adapter, switch on cap prefix in create_node_from_uri()
1251 client.py: move SecretHolder code out to a separate class
1252 test_web.py: hush pyflakes
1253 client.py: move NodeMaker functionality out into a separate object
1254 LiteralFileNode: stop storing a Client reference
1255 immutable Checker: remove Client reference, it only needs a SecretHolder
1256 immutable Upload: remove Client reference, leave SecretHolder and StorageBroker
1257 immutable Repairer: replace Client reference with StorageBroker and SecretHolder
1258 immutable FileNode: remove Client reference
1259 mutable.Publish: stop passing Client
1260 mutable.ServermapUpdater: get StorageBroker in constructor, not by peeking into Client reference
1261 MutableChecker: reference StorageBroker and History directly, not through Client
1262 mutable.FileNode: removed unused indirection to checker classes
1263 mutable.FileNode: remove Client reference
1264 client.py: move RSA key generation into a separate class, so it can be passed to the nodemaker
1265 move create_mutable_file() into NodeMaker
1266 test_dirnode.py: stop using FakeClient mockups, use NoNetworkGrid instead. This simplifies the code, but takes longer to run (17s instead of 6s). This should come down later when other cleanups make it possible to use simpler (non-RSA) fake mutable files for dirnode tests.
1267 test_mutable.py: clean up basedir names
1268 client.py: move create_empty_dirnode() into NodeMaker
1269 dirnode.py: get rid of DirectoryNode.create
1270 remove DirectoryNode.init_from_uri, refactor NodeMaker for customization, simplify test_web's mock Client to match
1271 stop passing Client to DirectoryNode, make DirectoryNode.create_with_mutablefile the normal DirectoryNode constructor, start removing client from NodeMaker
1272 remove Client from NodeMaker
1273 move helper status into History, pass History to web.Status instead of Client
1274 test_mutable.py: fix minor typo
1275]
1276[docs: edits for docs/running.html from Sam Mason
1277zooko@zooko.com**20090809201416
1278 Ignore-this: 2207e80449943ebd4ed50cea57c43143
1279]
1280[docs: install.html: instruct Debian users to use this document and not to go find the DownloadDebianPackages page, ignore the warning at the top of it, and try it
1281zooko@zooko.com**20090804123840
1282 Ignore-this: 49da654f19d377ffc5a1eff0c820e026
1283 http://allmydata.org/pipermail/tahoe-dev/2009-August/002507.html
1284]
1285[docs: relnotes.txt: reflow to 63 chars wide because google groups and some web forms seem to wrap to that
1286zooko@zooko.com**20090802135016
1287 Ignore-this: 53b1493a0491bc30fb2935fad283caeb
1288]
1289[docs: about.html: fix English usage noticed by Amber
1290zooko@zooko.com**20090802050533
1291 Ignore-this: 89965c4650f9bd100a615c401181a956
1292]
1293[docs: fix mis-spelled word in about.html
1294zooko@zooko.com**20090802050320
1295 Ignore-this: fdfd0397bc7cef9edfde425dddeb67e5
1296]
1297[TAG allmydata-tahoe-1.5.0
1298zooko@zooko.com**20090802031303
1299 Ignore-this: 94e5558e7225c39a86aae666ea00f166
1300]
1301Patch bundle hash:
130256685b8171f56ed3b859f1d808e1ea43274a4bdd