aboutsummaryrefslogtreecommitdiffstats
path: root/contrib/008523.html
blob: 535ffec54ac64513b38c17fb9ee38a6de7f026ab (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
 <HEAD>
   <TITLE> [fetchmail]fetchmail vs Maillenium; mail truncated to 80K
   </TITLE>
   <LINK REL="Index" HREF="index.html" >
   <LINK REL="made" HREF="mailto:jcfoley%40comcast.net">
   <META NAME="robots" CONTENT="index,nofollow">
   
   <LINK REL="Previous"  HREF="008522.html">
   <LINK REL="Next"  HREF="008524.html">
 </HEAD>
 <BODY BGCOLOR="#ffffff">
   <H1>[fetchmail]fetchmail vs Maillenium; mail truncated to 80K
   </H1>
    <B>jcfoley@comcast.net
    </B> 
    <A HREF="mailto:jcfoley%40comcast.net"
       TITLE="[fetchmail]fetchmail vs Maillenium; mail truncated to 80K">jcfoley@comcast.net
       </A><BR>
    <I>Fri, 23 Apr 2004 02:51:22 +0000</I>
    <P><UL>
        <LI> Previous message: <A HREF="008522.html">[fetchmail]fetchmail vs Maillenium; mail truncated to 80K
</A></li>
        <LI> Next message: <A HREF="008524.html">[fetchmail]fetchmail vs Maillenium; mail truncated to 80K
</A></li>
         <LI> <B>Messages sorted by:</B> 
              <a href="date.html#8523">[ date ]</a>
              <a href="thread.html#8523">[ thread ]</a>
              <a href="subject.html#8523">[ subject ]</a>
              <a href="author.html#8523">[ author ]</a>
         </LI>
       </UL>
    <HR>  
<!--beginarticle-->
<PRE>You're probably using a Comcast POP3 server.  Many others have
experienced this problem.  The problem is that the server truncates
the amount of data returned by the POP3 TOP command.  Comcast changed
to the Maillennium POP3 server in Summer 2003.  For several months
they refused to acknowledge any issue at their end that would account
for email truncation.  Recently the Comcast Government Affairs Manager
at Comcast of Montgomery (Maryland) sent me the information at the end
of this message.

I believe the Outlook Express flaw they reference was fixed a few
years ago.  Regardless it does seem to be a strange and non-conforming
server implementation that silently does the wrong thing specified by
the RFC and every other server I've used.

On the other hand, people have made the comment that fetchmail should
not be relying on TOP because a) that's not what it is for and/or b)
it is an optional POP3 command.

Item I8 of the fetchmail FAQ which appears to be maintained by Eric
S. Raymond says, &quot;Don't mistake this for a fetchmail bug.&quot;

It would be nice to hear from a fetchmail expert/authority on whether
fetchmail is doing the right thing by using TOP and for a rationale of
the FAQ's response.

If fetchmail's use of TOP is legitimate then maybe Comcast would
uncripple their server if more people complained.

Jim Foley

=======================================================================
=======================================================================

Date: Wed, 3 Mar 2004 11:59:17 -0500

Mr. Foley, this email responds to the questions you posed following our
conference call.

First, Comcast does support POP 3 TOP commands, however Comcast has found
that increasing the amount of data TOP returns beyond the value of 64K has a
tendency to crash Microsoft Outlook Express when an abnormally large header
is sent.  Increasing the value beyond 64K would open the platform to
malicious use of large headers that adversely impacts system performance.
Virtually all of Comcast's high-speed Internet customers use Outlook
Express. Comcast has not received requests from other subscribers who seek
to use the TOP command in the manner you have requested.  Further, Comcast
has not received any other complaints regarding email truncation with the
TOP command.  Should you wish to continue checking your mail through manual
commands you might try using the RETR command, which will return the entire
message.

...



Date: Fri, 5 Mar 2004 16:28:11 -0500

Mr. Foley:

This is in response to your question regarding &quot;POP 3 RFC compliance.&quot;  We
have tried to answer your question about Comcast's services by talking about
the specific application in which you are interested and how that
application relates to technical information regarding the configuration of
Comcast's Internet service.  We have provided you all the information that
we can by explaining that Comcast limits the optional POP 3 Top Command to a
value of 64k because any larger value has a tendency to crash Microsoft
Outlook and could leave Comcast's system open to the malicious use of large
headers intended to impair system performance.

The decision by Comcast to place limitations on the optional POP 3 TOP email
commands is a technical business decision made by Comcast in the best
interest of all its customers and its system. ...

...

With respect to the specific RFC at issue, RFC 1939, POP 3, it is our
understanding that it is a protocol &quot;intended to permit a workstation to
dynamically access a maildrop on a server host in a useful fashion.
Usually, this means that the POP3 protocol is used to allow a workstation to
retrieve mail that the server is holding for it.  Pop 3 is not intended to
provide extensive manipulation operations of mail on the server.&quot;  POP 3 was
created in May 1996 and has not been revised since, despite the many changes
in computer hardware and software related to handling of email since that
time.  In any event, the TOP command is identified as an optional POP 3
command in RFC 1939.

...


</PRE>
<!--endarticle-->
    <HR>
    <P><UL>
        <!--threads-->
	<LI> Previous message: <A HREF="008522.html">[fetchmail]fetchmail vs Maillenium; mail truncated to 80K
</A></li>
	<LI> Next message: <A HREF="008524.html">[fetchmail]fetchmail vs Maillenium; mail truncated to 80K
</A></li>
         <LI> <B>Messages sorted by:</B> 
              <a href="date.html#8523">[ date ]</a>
              <a href="thread.html#8523">[ thread ]</a>
              <a href="subject.html#8523">[ subject ]</a>
              <a href="author.html#8523">[ author ]</a>
         </LI>
       </UL>
</body></html>
>NEWS: FETCHMAIL 6.3.18 RELEASE</h1> <p style="background-color:#ffc0c0;color:#000000;">On 2010-10-16, <a href="fetchmail-EN-2010-03.txt">an erratum notice was issued</a> to document important fixes made in the 6.3.18 release listed below. Distributors are advised to upgrade their packages to 6.3.18.</p> <p>On 2010-10-09, <a href="http://developer.berlios.de/project/showfiles.php?group_id=1824">fetchmail-6.3.18 has been released (this is the download link),</a> fixing a regression of the rcfile parser from 6.3.0, a security bug in debug output that can cause memory exhaustion and abort, and improves SSL usability. It is a recommended update for all users and distributors. <a href="http://developer.berlios.de/project/shownotes.php?group_id=1824&amp;release_id=17957">Click here to see the change details.</a> </p> <h1>UTF7 in mailbox names (developer document)</h1> <p>There is a <a href="Mailbox-Names-UTF7.html">new document about mailbox name encoding in IMAP,</a> an invited contribution by Mark Crispin. It applies to all IMAP clients and servers and is not limited to fetchmail, and arose after a discussion on the getmail mailing list. Note that as of 2010-05-25, neither fetchmail nor getmail currently supports this directly; for the nonce, you need to manually encode the mailbox name in UTF-7 for both applications.</p> <h1>SSL issues after upgrade to OpenSSL 1.0.0?</h1> <p>If your fetchmail upgrade entails an upgrade of the OpenSSL library to 1.0.0, remember to re-run <kbd>c_rehash /path/to/certs</kbd>, where the last part is whatever argument you give to fetchmail's <code>sslcertpath</code> option. Details: please <a href="fetchmail-FAQ.html#R14">see fetchmail's FAQ item R14.</a>.</p> </div> <div style="background-color:#ffe0c0;color:#000000;font-size:85%"> <h1>SECURITY ALERTS</h1> <p>These have been moved <a href="security.html">to a separate page (click here for security information)</a> to unclutter the front page. <p style="font-size:100%"><strong>Please <a href="http://developer.berlios.de/project/showfiles.php?group_id=1824">update to the newest fetchmail version</a>.</strong></p> </div> <h1>What fetchmail does:</h1> <p>Fetchmail is a full-featured, robust, well-documented remote-mail retrieval and forwarding utility intended to be used over on-demand TCP/IP links (such as SLIP or PPP connections). It supports every remote-mail protocol now in use on the Internet: POP2, POP3, RPOP, APOP, KPOP, all flavors of <a href="http://www.imap.org">IMAP</a>, ETRN, and ODMR. It can even support IPv6 and IPSEC.</p> <p>Fetchmail retrieves mail from remote mail servers and forwards it via SMTP, so it can then be read by normal mail user agents such as <a href="http://www.mutt.org/">mutt</a>, elm(1) or BSD Mail. It allows all your system MTA's filtering, forwarding, and aliasing facilities to work just as they would on normal mail.</p> <p>Fetchmail offers better protection against password-sniffing than any other Unix remote-mail client. It supports APOP, KPOP, OTP, Compuserve RPA, Microsoft NTLM, and IMAP RFC1731 encrypted authentication methods including CRAM-MD5 to avoid sending passwords en clair. It can be configured to support end-to-end encryption via tunneling with <a href="http://www.openssh.com/">ssh, the Secure Shell</a>.</p> <p>Fetchmail can be used as a POP/IMAP-to-SMTP gateway for an entire DNS domain, collecting mail from a single drop box on an ISP and SMTP-forwarding it based on header addresses. (We don't really recommend this, though, as it may lose important envelope-header information. ETRN or a UUCP connection is better.)</p> <p>Fetchmail can be started automatically and silently as a system daemon at boot time. When running in this mode with a short poll interval, it is pretty hard for anyone to tell that the incoming mail link is not a full-time "push" connection.</p> <p>Fetchmail is easy to configure. You can edit its dotfile directly, or use the interactive GUI configurator (fetchmailconf) supplied with the fetchmail distribution. It is also directly supported in linuxconf versions 1.16r8 and later.</p> <p>Fetchmail is fast and lightweight. It packs all its standard features (POP3, IMAP, and ETRN support) in 196K of core on a Pentium under Linux.</p> <p>Fetchmail is <a href="http://www.opensource.org">open-source</a> and <a href="http://www.gnu.org/philosophy/free-sw.html">free software</a>.</p> <h1>Where to find out more about fetchmail:</h1> <p>See the <a href="fetchmail-features.html">Fetchmail Feature List</a> for more about what fetchmail does.</p> <p>See the on-line <a href="fetchmail-man.html">manual page</a> for basics.</p> <p>See the <a href="fetchmail-FAQ.html">HTML Fetchmail FAQ</a> for troubleshooting help.</p> <p>See the <a href="design-notes.html">Fetchmail Design Notes</a> for discussion of some of the design choices in fetchmail.</p> <p>See the project's <a href="todo.html">To-Do list</a> for indications of known problems and requested features.</p> <p>The developers use <a href="http://git-scm.com/">Git</a> for revision control. To browse the repository or to get the latest development version, find the instructions at <a href="http://gitorious.org/fetchmail/fetchmail">http://gitorious.org/fetchmail/fetchmail</a>.</p> <p>See the <a href="http://developer.berlios.de/projects/fetchmail/">project page</a> for more, including <a href="http://developer.berlios.de/project/showfiles.php?group_id=1824">downloads</a>.</p> <h1>Getting help with fetchmail:</h1> <p>Before submitting a question anywhere, <strong>please read the <a href="fetchmail-FAQ.html">FAQ</a></strong> (especially item <a href="fetchmail-FAQ.html#G3">G3</a> on how to report problems). We tend to get the same three newbie questions over and over again. The FAQ covers them like a blanket.</p> <p>There is a fetchmail-users list for help and other user discussion of fetchmail. It's a MailMan list, which you can sign up for at <a href="http://lists.berlios.de/mailman/listinfo/fetchmail-users"> fetchmail-users@lists.berlios.de</a>. <br>There is also a fetchmail-devel list for people who want to discuss fixes and improvements in fetchmail and help co-develop it. That one is at <a href="http://lists.berlios.de/mailman/listinfo/fetchmail-devel"> fetchmail-devel@lists.berlios.de</a>. <br>Finally, there is an announcements-only list, <a href="http://lists.berlios.de/mailman/listinfo/fetchmail-announce"> fetchmail-announce@lists.berlios.de</a>.</p> <h1>Maintainer History</h1> <p>Fetchmail originated as a program called <i>popclient</i>, written by Carl Harris. In 1996, <a href="http://www.catb.org/~esr/">Eric S. Raymond</a> took over; he soon renamed the program to fetchmail after adding IMAP support.</p> <p>In 2004 a new team took over, led by <a href="http://developer.berlios.de/users/rfunk/">Rob Funk</a>, <a href="http://developer.berlios.de/users/bob/">Graham Wilson</a>, and <a href="http://developer.berlios.de/users/m-a/">Matthias Andree</a>. Since then, Graham Wilson has retreated, and <a href="http://developer.berlios.de/users/shetye/">Sunil Shetye</a> has contributed several important pieces of code.</p> <h1>You can help improve fetchmail:</h1> <p>We welcome your code contributions. But even if you don't write code, you can help fetchmail improve.</p> <p><strong>If you administer a site that runs a post-office server, you may be able help improve fetchmail by lending us a test account on your site. Note that we do not need a shell account for this purpose, just a mailbox and a mail address. Nor are we interested in collecting maildrops per se -- what we're collecting is different <em>kinds of servers</em>.</strong></p> <p>Before each release, we run a test harness that sends date-stamped test mail to each site on our regression-test list, then tries to retrieve it. Please take a look at the <a href="testservers.html"> list of test servers</a>. If you can lend us an account on a kind of server that is <em>not</em> already on this list, please do.</p> <h1>Where you can use fetchmail:</h1> <p>The fetchmail code was developed under Linux, but has also been extensively tested under 4.4BSD, SunOS, Solaris, AIX, and NEXTSTEP. It should be readily portable to other Unix variants (it requires only POSIX plus BSD sockets, and uses GNU autoconf).</p> <p>Fetchmail is supported only for Unix by its official maintainers. However, it is reported to build and run correctly under BeOS, AmigaOS, Rhapsody, and QNX as well. There is a CygWin port.</p> <h1>Related works</h1> <h2>Similar software</h2> <p><strong>fdm:</strong> A recently appeared software package that integrates basic filtering is <a href="http://fdm.sourceforge.net/">Nicholas Marriott's fdm</a>. <p><strong>getmail:</strong> When fetchmail's development was stalled before the latest team took over, <a href="http://pyropus.ca/software/getmail/">Charles Cazabon's getmail</a> came along as an intended replacement. It still doesn't do everything that fetchmail does, and often suffers from Python library shortcomings, for instance when it comes to SSL, but it's close enough to give us a bit of competition.</p> <p><strong>animail:</strong> Another contender with integrated filtering is <a href="http://juanjoalvarez.net/animaileng">Juanjo �lvarez Mart�nez's Animail</a>.</p> <h2>Complementary and extension software</h2> <p>Jochen Hayek is developing a set of <a href="http://www.b.shuttle.de/hayek/JHimap_utils/"> IMAP tools in Python</a> that read your .fetchmailrc file and are designed to work with fetchmail. Jochen's tools can report selected header lines, or move incoming messages to named mailboxes based on the contents of headers.</p> <!-- no longer true <p>Donncha O Caoihm has written a Perl script called <a href="http://blogs.linux.ie/xeer/install-sendmail/">install-sendmail</a> that assists you in installing sendmail and fetchmail together.</p> --> <p>Peter Hawkins has written a script called <a href="http://linux.cudeso.be/linuxdoc/gotmail.php">gotmail</a> that can retrieve Hotmail. Another script, <a href="http://yosucker.sourceforge.net">yosucker</a>, can retrieve Yahoo webmail.</p> <p>There's a program called <a href="http://mailfilter.sourceforge.net/">mailfilter</a> which can be used to do spam filtering, that works particularly well called from fetchmail's <code>preconnect</code> directive.</p> <p>A hacker identifying himself simply as 'Steines' has written a filter which rewrites the to-line with a line which only includes receipients for a given domain and renames the old to-line. It also rewrites the domain-part of addresses if the offical domain is different from the local domain. You can find it <a href="http://www.steines.com/mailf/">here</a>.</p> </div> <p align="right"> <a href="http://validator.w3.org/check?uri=referer"><img src="http://www.w3.org/Icons/valid-html401-blue" alt="Valid HTML 4.01 Transitional" height="31" width="88"></a> <a href="http://jigsaw.w3.org/css-validator/"> <img style="border:0;width:88px;height:31px" src="http://jigsaw.w3.org/css-validator/images/vcss-blue" alt="Valid CSS"> </a> <a href="http://developer.berlios.de"> <img src="http://developer.berlios.de/bslogo.php?group_id=1824&amp;type=1" width="124" height="32" border="0" alt="BerliOS Logo"></a> </p> </body> </html>