aboutsummaryrefslogtreecommitdiffstats
path: root/CHANGELOG
blob: e17b4b8f049e92a598959f83373592ce5622be27 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
Version 0.7.3   - UNRELEASED

 * Fixed date header parsing to be precise with timezone information.  Also,
   when writing From_ line timestamps, don't use UTC but local time, without
   timezone information.
 * To determine the delivery date of a message, archivemail now looks for the
   timestamp of the latest 'Received' header before resorting to 'Date' or
   'Resent-Date'.  This should give much better results when there is no
   'Delivery-date' header.  (Thanks Andrew Ferrier & Christian Brabandt)
   Closes: #1481316, #1764855, Debian bug #272666.
 * If present, the 'Resent-date' header now takes precedence over 'Date'. 
 * IMAP: recognize when a server advertises LOGINDISABLED.
 * New option --debug-imap; this just sets imaplib.Debug, thereby dumping
   archivemail's chat with the server to stdout. 
 * Fixed crash with Python 2.5 when archiving an empty maildir. (Thanks
   "Aidant") Closes: #1878940.
 * New option --all to archive all messages in a mailbox.  Closes: #1764846.
 * Fixed a crash when archiving maildirs with --days=0. (Thanks John Goerzen)
 * IMAP: automatically add NAMESPACE prefix to a mailbox path if necessary. 

Version 0.7.2   - 9 November 2007

  * IMAP: fixed crash by working around python bug #1277098, which is still pending
    in python << 2.5. 

Version 0.7.1   - 7 November 2007

  * Fixed incompatibility with Python 2.5 which broke Maildir handling.
    Closes: #1670422
  * Username and password in IMAP URLs can now be double-quoted, so it should be
    no longer a problem if they contain delimiters like the '@' character. 
    Closes: #1640878
  * Invalid messages/files in Maildirs caused archivemail to silently stop
    processing mails and claim it's all done.  Now skip these and go ahead. 
    (Thanks Elan Ruusamäe for tracking this down.) Closes: #1783369.  
    (The Debian package has a different fix for this problem since 0.6.1-4,
    closing Debian bugs #255944 and #305902.)
  * Fixed IMAP message flag conversion which was completely broken. (Thanks
    Christian Brabandt)  Closes: Debian bug #434807
  * New option --copy: archive mail, but don't delete it from the mailbox. 
    This is mainly useful for testing purposes, and complements --delete.
    Closes: #981865, #988803, #1764851, Debian bug #434798
  * If running as root, only switch the effective uid and gid back if we have
    actually switched them before. Closes: #1762907
  * The automatic seteuid feature of archivemail is insecure and thus
    deprecated; it will be removed from later versions. 
  * Expand tilde in argument of long option --pwfile. (Thanks Christian
    Brabandt) Closes: Debian bug #434813
  * archivemail now accepts --days=0 
  * Fixed crash if --warn-duplicate is used with IMAP (Thanks Christian
    Brabandt) Closes: Debian bug #434786 (the Debian package already has a fix)
  * When converting from other formats to mbox, archivemail used to preserve
    existing 'Status' and 'X-Status' mbox headers; these are now silently
    overwritten to ensure they have correct values.
  * IMAP: if selecting the mailbox fails, archivemail detects the server's
    mailbox hierarchy delimiter, replaces slashes in the mailbox name with the
    delimiter and tries again. Closes: #1826757, Debian bug #368112

Version 0.7.0   - 2 November 2006
  * Fixed long options --filter-append and --pwfile to accept their arguments.
    Closes: #1555935
  * Fixed From_ line generation to actually look for the 'Return-path' and
    'From' headers.  Closes: #1555797
  * Fixed IMAP authentication/URL parsing, which wasn't working at all in
    v0.6.2.  Require username encoded in URL, but be flexible with the password:
    handle both --pwfile and URL-encoded password, and fallback to querying the
    user if neither is present.  Closes: #1555951
  * Convert on-the-wire CRLF to native EOL when saving messages from an IMAP
    folder.  Closes: #1555803
  * Updated man page.  This also addresses #1555951
  * Fixed unittest failure by updating --suffix testcase.  Based on analysis by
    Peter Poeml.  Thanks, Peter. 
  * Fixed invalid IMAP filter string for large messages (--size option).
    (Thanks to the anonymous bug reporter)  Closes: #863813
  * Fixed IMAP --dry-run so it doesn't download all messages that would be
    archived.  
  * Fixed IMAP --delete which didn't work at all.  (Thanks Anand)  
    Closes: Debian bug #203282
  * Terminate each message in newly written mbox with an empty line if the
    message source is not an mbox-format folder.  (Thanks  Chung-chieh Shan)
    Closes: Debian bug #250410
  * Mangle From_ in message body if the message source is not an mbox-format
    folder.  (Thanks Chung-chieh Shan)  Closes: Debian bug #250402
  * Added new option --dont-mangle to turn off From_ mangling.
  * Bumped Python dependency to version 2.3.
  * Fixed unittest TestMboxExclusiveLock which failed on Solaris.  (Thanks Paul
    Rodger)  Closes: #904652
  * Fixed unsafe creation of temporary files in the test suite.
    This addresses Debian bug #385253, and reading the BTS log, it seems this
    issue was assigned CVE-2006-4245, although I cannot find any further
    reference to that CVE.  Note that the bug was initially reported to affect
    archivemail itself, too.  This is not correct.  (Thanks Joey Hess)
    Closes: Debian bug #385253
  * Fixed cleanup of temporary files after test suite failures. 
  * Fixed dotlocking race condition. 
  * Stats are now working with IMAP.
  * Stats now report the total size of a mailbox and of the archived messages
    therefrom.  
  * Always barf if the archive destination directory is world-writable.
  * Distributing man page with the tarball again and fixed distutils setup.
    Closes: #1574720 (Thanks Grant Goodyear)
  * Improved IMAP error reporting

Version 0.6.2   - 27 June 2006
  * add -F/--filter-append option to append an arbitrary string to the IMAP 
    filter string
  * don't delete more than a certain number of messages at a time. The max 
    command len is limited. Fixes bug 942403 (Archiving large IMAP folders fails)
  * IMAP: try CRAM-MD5 login first, if that fails fallback to plain login
  * add SSL support per imaps URL (after patch by Tobias Gruetzmacher)
  * add -P/--pwfile option to supply the IMAP password, so it does not end up in 
    the shell history
  * Fix SyntaxWarning: assignment to None (bug #843890)
  * Use the archive cut date rather than the actual time with the --suffix
    option. (Thanks Manuel Estrada Sainz)

Version 0.6.1   - 31 October 2002
  * Removed a test rule that we could archive messages older than the 
    Unix epoch. Newer versions of python now give an overflow error calling
    mktime() on dates < 1970 instead of returning a negative number.

Version 0.6.0   - 3 October 2002
  * Added IMAP mailbox support. (Thanks Mark Roach)

Version 0.5.1   - 18 September 2002
  * Fixed a bug where when running archivemail as root on a non-root mailbox,
    the temporary container directory would be created as root before the
    seteuid() took place. (Thanks Jay Hesselberth)

Version 0.5.0   - 15 September 2002
  * Fixed a bug where mailbox locking would fail under Solaris. (Thanks Mark
    Sheller)
  * Fixed a bug where archiving maildir mailboxes without a 'Received Date' or
    'From' header would fail. (Thanks Hugo van der Merwe)
  * Removed yet another bug where messages dated on the Unix epoch would fail.

Version 0.4.9   - 18 August 2002
  * Fixed a bug where an exception was thrown if a message was dated exactly
    on the Unix epoch.
  * Fixed a bug where trailing slashes on the end of maildir/MH mailbox
    arguments were being used in the archive name.

Version 0.4.8   - 20 May 2002
  * Call mkdir() to create a container directory in which we can place any
    created tempfiles 

Version 0.4.7   - 9 May 2002
  * Fixed a bug where archivemail would abort if it received a date header
    with a completely blank value.

Version 0.4.6   - 6 May 2002
  * Fixed a bug where the os.rename() calls could fail if we were moving
    temporary files across different filesystems/partitions.

Version 0.4.5   - 29 April 2002
  * Fixed a bug where if you used the '--delete' option to completely clean
    an mbox mailbox you would get a python error.
  * Added a lot more testing to test_archivemail.py (test_archivemail.py is
    now 37% bigger than archivemail -- scary)
  * Added a new '--size' option which allows you to only archive messages 
    over a certain size.

Version 0.4.4   - 27 April 2002
  * Fixed a bug where the long --suffix option was not working (although the 
    short option, '-s' was).
  * Added time-based format directives to the --suffix option, so that you 
    can do things like specify --suffix='%B%Y' to create archives named
    after the current month and year
  * Added some more tests to test_archivemail.py

Version 0.4.3   - 26 April 2002
  * Fixed a couple of bugs where I was using python version 2.2 syntax that
    was giving errors in python v2.0 and v2.1. 
  * Changed the python requirements for the test script from python version
    2.0 to version 2.1. This is because the unittest module is only available
    in version 2.1 and above.

Version 0.4.2   - 24 April 2002
  * Added the ability to archive messages older than a given absolute date 
    with the new option '--date'.
  * Fixed a bug where archivemail would complain about messages older than 
    1970. Yes, someone had a 'Date' header with 1967 :)
  * Complain if the mailbox to be read does not look like a valid mbox-format
    mailbox.
  * Added a few more tests to test_archivemail.py

Version 0.4.1   - 21 April 2002
  * Don't archive messages that are flagged important unless we are given the
    --include-flagged option. 
  * Fixed a bug where when archiving messages from maildir mailboxes, we were
    not preserving the status information contained in the filename suffix to
    Status and X-Status mbox headers. This means we forgot if we had read or 
    replied to the message.
  * We now complain if an mbox-format mailbox that is being read changes in 
    size -- this should not happen, since we have locked these files, but it
    is a good sanity check.
  * Changed from using the mailbox.PortableUnixMailbox class to read mbox 
    mailboxes to the mailbox.UnixMailbox class. This fixes bugs where unquoted
    'From ' lines in the body of messages were confusing archivemail.

Version 0.4.0   - 17 April 2002
  * Added an option --no-compress to make archives but not compress them with  
    gzip.
  * Added an option --preserve-unread to not archive unread messages.
  * Added a few more unittests.

Version 0.3.2   - 13 April 2002
  * Added a lot more information to the manpage, including examples and 
    notes.
  * Fixed up the README file and archivemail usage message.
  * Added an example archivemail shell script that I run from crontab.

Version 0.3.1   - 12 April 2002
  * Stopped calling 'gzip' externally and started using the gzip library
    so that we can append to a copy of the gzip archive directly. 
  * Removed 'bzip2' and 'compress' options since they are increasing
    complexity without adding much, and needed to be called externally.
    Maybe when python gets a bzip2 library I will add back an option to 
    compress archives using bzip2.
  * Included a man page & sgml docbook source.

Version 0.3.0   - 11 April 2002
  * We now preserve the last-accessed and last-modified timestamps correctly
  * We now preserve the correct permissions on the original mailbox instead
    of always mode 600
  * Fixed a bug where lockfiles were being created that were not
    world-readable
  * Made archivemail work better when used as a python module so it can
    integrate better with unittest. (... although I still distribute it 
    without the .py extension - dodgy?)
  * Bundled a unit-testing script for archivemail 
  * Started using a distutils 'setup.py' script for installation.

Version 0.2.1   - 4 April 2002
  * Since we might not have a parse-able 'Date-Received' or 'Date' field,
    use 5 different ways to guess the date of a message. 
  * Removed the '--use-mtime' option since it is obsolete -- we will always
    use the file modification time for the message if other date-parsing
    methods fail.  
  * Check to see if we are running as root -- if so, change our
    effective userid and groupid to that of the original mailbox. This will 
    make sure any archives or tempfiles we write have the same ownership and 
    will allow the root user to do "archivemail /var/spool/mail/*"
  * Fixed a bug where if you ran 'archivemail.py foo/mbox' it would create 
    the archive file in the current directory instead of the directory 'foo'.

Version 0.2.0   - 3 April 2002
  * Added support for reading from MH mailboxes
  * Refuse to proceed if we would be making tempfiles in world-writable
    directories
  * Clamped down with lots of assert()s checking function parameters
  * Complain earlier if we do not have permission to write to the output
    directory
  * Use the 'Date' field of a message when constructing the 'From_' line
    from a maildir/MH mailbox if there is no 'Delivery-Date' field.

Version 0.1.0   - 31 March 2002
  * Initial release
w"> = None # Nor a package name homepage = None # Nor a home page arch = None # The machine architecture keywords = None # Keywords for LSMs freshmeat_name = None # Name of the project ob Freshmeat changelog = None # Project changelog lastchange = None # Last entry in changelog summary = None # One-line summary of the package description = None # Nor a description indextemplate = """ <?xml version="1.0" encoding="ISO-8859-1"?> <!DOCTYPE html PUBLIC '-//W3C//DTD XHTML 1.0 Transitional//EN' 'http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd'> <html> <head> <link rel='stylesheet' href='/~esr/sitestyle.css' type='text/css' /> <meta name='description' content='Resource page for %(package)s' /> <meta name='generator' content='shipper' /> <meta name='MSSmartTagsPreventParsing' content='TRUE' /> <title>Resource page for %(package)s %(version)s</title> </head> <body> <h1>Resource page for %(package)s %(version)s</td></h1> <p>%(description)s</p> <br /> %(resourcetable)s <br /> <p>Last modified %(date)s.</p> </div> </body> </html> """ mailtemplate = """Subject: Announcing release %(version)s of %(package)s Release %(version)s of %(package)s is now available at: %(homepage)s Here are the most recent changes: %(lastchange)s -- shipper, acting for %(whoami)s """ # It's unpleasant that we have to include these here, but # the freshmeat release focus has to be validated even if the # user is offline and the XML-RPC service not accessible. freshmeat_focus_types = ( "N/A", "Initial freshmeat announcement", "Documentation", "Code cleanup", "Minor feature enhancements", "Major feature enhancements", "Minor bugfixes", "Major bugfixes", "Minor security fixes", "Major security fixes", ) def croak(msg): sys.stderr.write("shipper: " + msg + "\n") sys.exit(1) # # Shipping methods # def do_or_die(cmd): "Wither execute a command or fail noisily" if options.verbose: print "***", cmd if os.system(cmd): croak("command '%s' failed!" % cmd) def upload_or_die(cmd): if options.noupload: print cmd else: do_or_die(cmd) def upload(destination, files): # Upload a file via ftp or sftp, handles print "# Uploading to %s" % destination files = filter(os.path.exists, files) if destination.startswith("ftp://"): destination = destination[6:].split("/") host = destination.pop(0) directory = "/".join(destination) commands = ["lftp", "open -u anonymous," + whoami + " " + host + "\n"] if directory: commands.append("cd " + directory + "\n") commands.append("mput " + " ".join(files) + "\n") commands.append("close\n") if options.noupload: print "".join(commands) else: pfp = os.popen(commands.pop(0), "w") pfp.writelines(commands) pfp.close() elif destination.find("::") > -1: upload_or_die("rsync " + " ".join(files) + " " + destination) elif destination.find(":") > -1: (host, directory) = destination.split(":") for file in files: # This is a really ugly way to deal with the problem # of write-protected files in the remote directory. # Unfortunately, sftp(1) is rather brain-dead -- no # way to ignore failure on a remove, and refuses to # do renames with an obscure error message. remote = os.path.join(directory, package, file) upload_or_die("scp " + file + " " + host + ":" + remote+".new;") upload_or_die("ssh %s 'mv -f %s.new %s'" % (host, remote, remote)) else: sys.stderr.write("Don't know what to do with destination %s!") def freshmeat_ship(manifest): "Ship a specified update to freshmeat." if options.verbose: print "Announcing to freshmeat..." upload_or_die("freshmeat-submit <" + manifest[0]) # # Metadata extraction # def grep(pattern, file): "Mine for a specified pattern in a file." fp = open(file) try: while True: line = fp.readline() if not line: return None m = re.search(pattern, line) if m: return m.group(1) finally: fp.close() return None class Specfile: def __init__(self, filename): self.filename = filename self.type = None if filename.endswith(".spec"): self.type = "RPM" self.package = self.extract("Name") self.version = self.extract("Version") self.homepage = self.extract("URL") self.summary = self.extract("Summary") self.arch = self.extract("BuildArch") or commands.getoutput("rpm --showrc | sed -n '/^build arch/s/.* //p'") self.description = self.rpm_get_multiline("description") self.changelog = self.rpm_get_multiline("changelog") elif filename == "control": self.type = "deb" self.name = self.extract("Package") self.version = self.extract("Version").split("-")[0] self.homepage = self.extract("XBS-Home-Page") self.summary = self.extract("Description") self.arch = self.extract("Architecture") if not self.arch: croak("this control file lacks an Architecture field") # FIXME: parse Debian description entries and changelog file self.description = self.changelog = None def extract(self, fld): "Extract a one-line field, possibly embedded as a magic comment." if self.type == "RPM": return grep("^#?"+fld+":\s*(.*)", self.filename) elif self.type == "deb": return grep("^(?:XBS-)?"+fld+": (.*)", self.filename) def rpm_get_multiline(self, fieldname): "Grab everything from leader line to just before the next leader line." global desc fp = open(self.filename) desc = "" gather = False while True: line = fp.readline() if not line: break # Pick up fieldnames *without* translation options. if line.strip() == "%" + fieldname: gather = True continue elif line[0] == "%": gather = False if gather: desc += line fp.close() if desc: return desc.strip() + "\n" else: return None # # Main sequence # try: # # Process options # parser = optparse.OptionParser(usage="%prog: [-h] [-n] [-f] [-v]") parser.add_option("-v", "--verbose", action="store_true", dest="verbose", default=False, help="print progress messages to stdout") parser.add_option("-n", "--noupload", action="store_true", dest="noupload", default=False, help="don't do uploads, just build deliverables") parser.add_option("-N", "--nobuild", action="store_true", dest="nobuild", default=False, help="dump configuration only, no builds or uploads") parser.add_option("-f", "--force", action="store_true", dest="force", default=False, help="force rebuilding of all local deliverables") (options, args) = parser.parse_args() # # Extract metadata and compute control information # def disable(s): channels.remove(s) # Security check, don't let an attacker elevate privileges def securecheck(file): if stat.S_IMODE(os.stat(file).st_mode) & 00002: croak("%s must not be world-writeable!" % file) # Read in variable overrides securecheck(".") home_profile = os.path.join(os.getenv('HOME'), ".shipper") if os.path.exists(home_profile): securecheck(home_profile) execfile(home_profile) here_profile = ".shipper" if os.path.exists(here_profile): securecheck(here_profile) execfile(here_profile) # Set various sensible defaults if not whoami: whoami = os.getenv('USERNAME') + "@" + os.getenv('HOSTNAME') # Where to get the metadata specfiles = glob.glob("*.spec") if len(specfiles) == 1: metadata = Specfile(specfiles[0]) elif os.path.exists("control"): metadata = Specfile("control") else: croak("must be exactly one RPM or dpkg specfile in the directory!") # Get the package name if not package: package = metadata.package if not package: croak("can't get package name!") # Extract the package vers from the specfile or Makefile specvers = metadata.version makevers = None if os.path.exists("Makefile"): makevers = grep("^VERS[A-Z]* *= *(.*)", "Makefile") # Maybe it's a shell command intended to extract version from specfile if makevers and makevers[0] == '$': makevers = commands.getoutput(makevers[7:-1]) if specvers != makevers: croak("specfile version %s != Makefile version %s"%(specvers,makevers)) elif specvers == None: croak("can't get package version") elif specvers[0] not in "0123456789": croak("package version %s appears garbled" % specvers) else: version = specvers # Specfiles may set their own destinations local_destinations = metadata.extract("Destinations") if local_destinations: local_destinations = map(lambda x: x.strip(), local_destinations.split(",")) destinations += local_destinations if not destinations: print "warning: destinations empty, shipping to public channels only." print"# Uploading version %s of %s" % (version, package) # Extract remaining variables for templating if not homepage: homepage = metadata.homepage if not date: date = time.asctime() if not summary: summary = metadata.summary if not description: description = metadata.description if not arch: arch = metadata.arch if not keywords: keywords = metadata.extract("Keywords") if not freshmeat_name: freshmeat_name = metadata.extract("Freshmeat-Name") # Finally, derive the change log and lastchange entry; # we'll need the latter for freshmeat.net freshmeat_lastchange = lastchange = changelog = None # ChangeLog, if present, takes precedence; # we assume if both are present that the specfile log is about packaging. if os.path.exists("ChangeLog"): ifp = open("ChangeLog", "r") changelog = ifp.read() ifp.close() lastchange = "" for line in changelog.split("\n"): while line.strip() or not "*" in lastchange: lastchange += line + "\n" else: break # freshmeat.net doesn't like bulleted items in a changes field. freshmeat_lastchange = "See the ChangeLog file for recent changes." elif metadata.changelog: changelog = metadata.changelog lastchange = "" for line in changelog.split("\n"): if not lastchange and (not line.strip() or line[0] == '*'): continue elif line.strip(): lastchange += line + "\n" else: break # This usually produces a lastchange entry that freshmeat will take. freshmeat_lastchange = lastchange # # Now compute the names of deliverables # # These are all potential deliverable files that include the version number tarball = package + "-" + version + ".tar.gz" srcrpm = package + "-" + version + "-1.src.rpm" binrpm = package + "-" + version + "-1." + arch + ".rpm" zip = package + "-" + version + ".zip" lsm = package + "-" + version + ".lsm" # Map web deliverables to explanations for the resource table # Stuff not included here: ANNOUNCE.EMAIL, ANNOUNCE.FRESHMEAT, lsm. stock_deliverables = [ ("README", "roadmap file"), (tarball, "source tarball"), (zip, "ZIP archive"), (binrpm, "installable RPM"), # Generated (srcrpm, "source RPM"), # Generated ("ChangeLog", "change log"), ("CHANGES", "change log"), # Generated ("NEWS", "Project news"), ("HISTORY", "Project history"), ("BUGS", "Known bugs"), ("TODO", "To-do file"), ] # # Might be time to dump # if options.nobuild: for variable in ('destinations', 'channels', 'whoami', 'date', 'package', 'homepage', 'arch', 'keywords', \ 'freshmeat_name', 'summary'): print "%s = %s" % (variable, `eval(variable)`) for variable in ('description', 'changelog', 'lastchange', 'mailtemplate', 'indextemplate'): if not eval(variable): print "No %s" % variable else: print "%s = <<EOF\n%sEOF" % (variable, eval(variable)) sys.exit(0) # # Build deliverables # suppress = " >/dev/null 2>&1" if options.verbose: suppress = "" # Sanity checks if not os.path.exists(tarball): croak("no tarball %s!" % tarball) if metadata.type == "RPM" and not metadata.extract("BuildRoot"): croak("specfile %s doesn't have a BuildRoot!" % metadata.filename) def newer(f1, f2): return os.path.exists(f1) and (os.stat(f1).st_mtime > os.stat(f2).st_mtime) # Compute the deliverables, we need this even if not rebuilding the index web_deliverables = [] # Anything in the list of standard deliverables is eligible. for (file, explanation) in stock_deliverables: if os.path.exists(file): web_deliverables.append((file, explanation)) # So is anything with an HTML extendion for file in glob.glob('*.html'): if file == 'index.html': continue stem = file[:-4] for ext in ("man", "1", "2", "3", "4", "5", "6", "7", "8", "9", "xml"): if os.path.exists(stem + ext): explanation = "HTML rendering of " + stem + ext break else: explanation = "HTML page." web_deliverables.append((file, explanation)) # Compute final deliverables deliverables = map(lambda x: x[0], web_deliverables)+["index.html"] try: delete_at_end = [] # RPMs first. if options.force or \ (not os.path.exists(binrpm) or not os.path.exists(srcrpm)): print "# Building RPMs..." if newer(srcrpm, tarball) and newer(binrpm, tarball): print "RPMs are up to date" else: do_or_die("buildrpms %s %s" % (tarball, suppress)) delete_at_end.append(srcrpm) delete_at_end.append(binrpm) # Next, the LSM if needed if 'ibiblio' in channels and \ (options.force or not os.path.exists(lsm)): print "# Building LSM..." if keywords: do_or_die("rpm2lsm -k '"+keywords+"' "+binrpm+" >"+lsm) else: print "# Warning: LSM being built with no keywords." do_or_die("rpm2lsm " + binrpm + ">" + lsm) delete_at_end.append(lsm) # Next the index page if it doesn't exist. if homepage and (options.force or not os.path.exists("index.html")): print "# Building index page..." # Now build the resource table resourcetable = '<table border="1" align="center" summary="Downloadable resources">\n' for (file, explanation) in web_deliverables: resourcetable += "<tr><td><a href='%s'>%s</a></td><td>%s</td></tr>\n" % (file,file,explanation) resourcetable += "</table>" # OK, now build the index page itself ofp = open("index.html", "w") ofp.write(indextemplate % globals()) ofp.close() delete_at_end.append("index.html") # Next the CHANGES file. Build this only if (a) there is no ChangeLog, # and (b) there is a specfile %changelog. if not os.path.exists("ChangeLog") and \ (options.force or not os.path.exists("CHANGES")) and changelog: print "# Building CHANGES..." ofp = open("CHANGES", "w") ofp.write(" Changelog for " + package + "\n\n") ofp.write(changelog) ofp.close() delete_at_end.append("CHANGES") # The freshmeat announcement if 'freshmeat' in channels \ and options.force or not os.path.exists("ANNOUNCE.FRESHMEAT"): print "# Building ANNOUNCE.FRESHMEAT..." if not homepage: print "# Can't announce to freshmeat without a primary website!" elif not lastchange: print "# Can't announce to freshmeat without a changes field!" else: while True: focus = raw_input("# freshmeat.net release focus (? for list): ") if focus == '?': i = 0 for f in freshmeat_focus_types: print "%d: %s" % (i, f) i += 1 elif focus in "0123456789": print "# OK:", freshmeat_focus_types[int(focus)] break elif focus.lower() in map(lambda x: x.lower(), freshmeat_focus_types): break else: croak("not a valid freshmeat.net release focus!") ofp = open("ANNOUNCE.FRESHMEAT", "w") ofp.write("Project: %s\n"%(freshmeat_name or package)) ofp.write("Version: %s\n"% version) ofp.write("Release-Focus: %s\n" % focus) ofp.write("Home-Page-URL: %s\n" % homepage) if os.path.exists(tarball): ofp.write("Gzipped-Tar-URL: %s\n" % os.path.join(homepage,tarball)) if os.path.exists(zip): ofp.write("Zipped-Tar-URL: %s\n" % os.path.join(homepage, zip)) if os.path.exists("CHANGES"): ofp.write("Changelog-URL: %s\n" % os.path.join(homepage, "CHANGES")) if os.path.exists(binrpm): ofp.write("RPM-URL: %s\n" % os.path.join(homepage, binrpm)) # freshmeat.net doesn't like bulleted entries. freshmeatlog = lastchange[2:].replace("\n ", "\n") ofp.write("\n" + freshmeatlog) ofp.close() delete_at_end.append("ANNOUNCE.FRESHMEAT") # Finally, email notification if filter(lambda x: x.startswith("mailto:"), destinations) \ and (options.force or not os.path.exists("ANNOUNCE.EMAIL")): print "# Building ANNOUNCE.EMAIL..." ofp = open("ANNOUNCE.EMAIL", "w") ofp.write(mailtemplate % globals()) ofp.close() delete_at_end.append("ANNOUNCE.FRESHMEAT") # # Now actually ship # # Shipping methods, locations, and deliverables for public channels. hardwired = { 'freshmeat' : (lambda: freshmeat_ship(("ANNOUNCE.FRESHMEAT",))), 'ibiblio' : (lambda: upload("ftp://ibiblio.org/incoming/linux", (tarball, binrpm, srcrpm, lsm))), 'redhat' : (lambda: upload("ftp://incoming.redhat.com/libc6", (tarball, binrpm, srcrpm))), } # First ship to private channels. Order is important here, we # need to hit the user's primary website first so everything # will be in place when announcements are generated. for destination in destinations: if destination.startswith("ftp:"): upload(destination, (tarball, binrpm, srcrpm,)) elif destination.startswith("mailto:"): print "# Mailing to %s" % destination command = "sendmail -i -oem -f %s %s <ANNOUNCE.EMAIL" % (whoami, destination[7:]) if options.noupload: print command else: do_or_die(command) else: upload(destination, deliverables) # Now ship to public channels for channel in channels: print "# Shipping to public channel", channel apply(hardwired[channel]) finally: cleanup = "rm -f " + " ".join(delete_at_end) if options.noupload: print cleanup else: for file in delete_at_end: os.system(cleanup) print "# Done" except KeyboardInterrupt: print "# Bye!" # The following sets edit modes for GNU EMACS # Local Variables: # mode:python # End: