[carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

classic Classic list List threaded Threaded
16 messages Options
Reply | Threaded
Open this post in threaded view
|

[carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

Carsten Otto-5
Hi again,

please fix (and invent some mechanism to do this automatically without
me reminding you).

Bye,
Carsten

----- Forwarded message from [hidden email] -----

Date: Fri, 30 Nov 2012 15:48:16 +0100 (CET)
From: [hidden email]
To: [hidden email]
Subject: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16

rsync: send_files failed to open "/stardust/publish.log" (in eclipseMirror): Permission denied (13)
rsync: send_files failed to open "/stardust/publish.log.wget.eclipse" (in eclipseMirror): Permission denied (13)
rsync: send_files failed to open "/stardust/publish.log.wget.maven" (in eclipseMirror): Permission denied (13)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1526) [generator=3.0.7]


----- End forwarded message -----

--
Carsten Otto           [hidden email]
LuFG Informatik 2      http://verify.rwth-aachen.de/otto/
RWTH Aachen            phone: +49 241 80-21211

_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors

signature.asc (205 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: [carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

Eclipse Webmaster (Denis Roy)
Carsten,

This is already fixed.  I see the errors at the same time you do and I fix them, but the email is already in your inbox.

You will never an always-error-free rsync from us.  Please let it go, we all have other fish to fry  :-)

Denis



On 11/30/2012 09:50 AM, Carsten Otto wrote:
Hi again,

please fix (and invent some mechanism to do this automatically without
me reminding you).

Bye,
Carsten

----- Forwarded message from [hidden email] -----

Date: Fri, 30 Nov 2012 15:48:16 +0100 (CET)
From: [hidden email]
To: [hidden email]
Subject: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16

rsync: send_files failed to open "/stardust/publish.log" (in eclipseMirror): Permission denied (13)
rsync: send_files failed to open "/stardust/publish.log.wget.eclipse" (in eclipseMirror): Permission denied (13)
rsync: send_files failed to open "/stardust/publish.log.wget.maven" (in eclipseMirror): Permission denied (13)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1526) [generator=3.0.7]


----- End forwarded message -----



_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors


_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors
Reply | Threaded
Open this post in threaded view
|

Re: [carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

Carsten Otto-5
Hi Roy,

On Fri, Nov 30, 2012 at 10:06:53AM -0500, Eclipse Webmaster (Denis Roy) wrote:
> This is already fixed.  I see the errors at the same time you do and
> I fix them, but the email is already in your inbox.

Ah, OK. The error appeared 18 hours ago, though. I'll wait a bit longer
in the future :)

> You will never an always-error-free rsync from us.  Please let it
> go, we all have other fish to fry  :-)

After some error mails (in this case 3, in the future some more) showing
the same error I want the error to be fixed. There is no way around
that, feel free to suggest a solution.

Bye,
--
Carsten Otto           [hidden email]
LuFG Informatik 2      http://verify.rwth-aachen.de/otto/
RWTH Aachen            phone: +49 241 80-21211

_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors

signature.asc (205 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: [carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

Denis Roy
FWIW, I have an rsync --list-only that runs every 2 hours, so I get the error emails every 2 hours to motivate me to investigate and fix.

D.



On 11/30/2012 10:11 AM, Carsten Otto wrote:
Hi Roy,

On Fri, Nov 30, 2012 at 10:06:53AM -0500, Eclipse Webmaster (Denis Roy) wrote:
This is already fixed.  I see the errors at the same time you do and
I fix them, but the email is already in your inbox.
Ah, OK. The error appeared 18 hours ago, though. I'll wait a bit longer
in the future :)

You will never an always-error-free rsync from us.  Please let it
go, we all have other fish to fry  :-)
After some error mails (in this case 3, in the future some more) showing
the same error I want the error to be fixed. There is no way around
that, feel free to suggest a solution.

Bye,


_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors


_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors
Reply | Threaded
Open this post in threaded view
|

Re: [carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

Carsten Otto-5
On Fri, Nov 30, 2012 at 11:03:26AM -0500, Denis Roy wrote:
> FWIW, I have an rsync --list-only that runs every 2 hours, so I get
> the error emails every 2 hours to motivate me to investigate and
> fix.

Good. Just to let you know: the error still persists.
--
Carsten Otto           [hidden email]
LuFG Informatik 2      http://verify.rwth-aachen.de/otto/
RWTH Aachen            phone: +49 241 80-21211

_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors

signature.asc (205 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: [carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

Carsten Otto-5
In reply to this post by Denis Roy
Hi,

On Fri, Nov 30, 2012 at 11:03:26AM -0500, Denis Roy wrote:
> FWIW, I have an rsync --list-only that runs every 2 hours, so I get
> the error emails every 2 hours to motivate me to investigate and
> fix.

it seems you overlooked an error. Please fix it.

Thanks,
--
Carsten Otto           [hidden email]
LuFG Informatik 2      http://verify.rwth-aachen.de/otto/
RWTH Aachen            phone: +49 241 80-21211

_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors

signature.asc (205 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: [carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

Carsten Otto-5
On Mon, Jan 28, 2013 at 10:09:08PM +0100, Carsten Otto wrote:
> it seems you overlooked an error. Please fix it.

A response would be nice.
--
Carsten Otto           [hidden email]
LuFG Informatik 2      http://verify.rwth-aachen.de/otto/
RWTH Aachen            phone: +49 241 80-21211

_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors

signature.asc (205 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: [carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

Carsten Otto-5
I stopped our rsync cronjob until the issue is resolved.
--
Carsten Otto           [hidden email]
LuFG Informatik 2      http://verify.rwth-aachen.de/otto/
RWTH Aachen            phone: +49 241 80-21211

_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors

signature.asc (205 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: [carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

Carsten Otto-5
Hi,

another week has passed. Could you please comment on the issue?

Thanks,
--
Carsten Otto           [hidden email]
LuFG Informatik 2      http://verify.rwth-aachen.de/otto/
RWTH Aachen            phone: +49 241 80-21211

_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors

signature.asc (205 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: [carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

Carsten Otto-5
Hi again,

another week has passed. Please have a look into this. Please bear in
mind that we stopped mirroring until the issue is resolved.

Annoyed regards,
--
Carsten Otto           [hidden email]
LuFG Informatik 2      http://verify.rwth-aachen.de/otto/
RWTH Aachen            phone: +49 241 80-21211

_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors

signature.asc (205 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: [carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

Carsten Otto-5
Hi again,

please show a sign of activity.

On Wed, Feb 13, 2013 at 10:41:50AM +0100, Carsten Otto wrote:
> Hi again,
>
> another week has passed. Please have a look into this. Please bear in
> mind that we stopped mirroring until the issue is resolved.
>
> Annoyed regards,

--
Carsten Otto           [hidden email]
LuFG Informatik 2      http://verify.rwth-aachen.de/otto/
RWTH Aachen            phone: +49 241 80-21211

_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors

signature.asc (205 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: [carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

Denis Roy
Sorry Carsten, everyone is super busy and frankly, there are bigger fish to fry.

If you're looking for a 100% error-free rsync service, please pull from OSU OSL or Georgia tech.


Denis




On 02/20/2013 05:23 AM, Carsten Otto wrote:
Hi again,

please show a sign of activity.

On Wed, Feb 13, 2013 at 10:41:50AM +0100, Carsten Otto wrote:
Hi again,

another week has passed. Please have a look into this. Please bear in
mind that we stopped mirroring until the issue is resolved.

Annoyed regards,

      

_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors


_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors
Reply | Threaded
Open this post in threaded view
|

Re: [carsten@c-otto.de: [ftpsync-eclipse-ftp@ftp] (8422) rsync ERROR on 2012.11.30-15:48:16]

Carsten Otto-5
In reply to this post by Carsten Otto-5
On Thu, Jan 31, 2013 at 03:47:22PM +0100, Carsten Otto wrote:
> I stopped our rsync cronjob until the issue is resolved.

Dear Eclipse team,

it seems you still have no proper mechanism to deal with errors on your
mirror or mails from the admins like me that access your mirror. I
disabled mirroring for ftp.halifax.rwth-aachen.de at the end of January
this year and _still_ did not get any response regarding the original
issue or the deactivation. Fortunately our mirror is not offered for
downloads that we cannot provide, so technically there is no real reason
to deal with this issue right now.

Nevertheless I'd love to have the following questions answered:

1) Do you want us to mirror your data?
2) If so, do you care about errors on your side?
3) If so, what do you do against that? How do you plan to react to
   notifications from the outside (e.g. me)?

Best regards,
--
Carsten Otto           [hidden email]
LuFG Informatik 2      http://verify.rwth-aachen.de/otto/
RWTH Aachen            phone: +49 241 80-21211

_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors

signature.asc (205 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: (8422) rsync ERROR on 2012.11.30-15:48:16]

Denis Roy
On 04/18/2013 03:17 AM, Carsten Otto wrote:
On Thu, Jan 31, 2013 at 03:47:22PM +0100, Carsten Otto wrote:
I stopped our rsync cronjob until the issue is resolved.
Nevertheless I'd love to have the following questions answered:

1) Do you want us to mirror your data?
Yes.  Without mirrors, Eclipse users could not download Eclipse.
2) If so, do you care about errors on your side?
On _our_ side, no.  We do not "care" because, if the project teams want users to download their bits, it will be quickly apparent that there is a problem and they will fix their permissions.

However, I do care about errors on _your_ side if _you_ care about errors on your side.  I was under the assumption that most mirrors simply sent errors to /dev/null since, as above, if there were permissions problems, the onus is on us to fix them.



3) If so, what do you do against that? How do you plan to react to
   notifications from the outside (e.g. me)?

I've opened this bug: https://bugs.eclipse.org/bugs/show_bug.cgi?id=405981

For now, the best I could do is a "reactive" system -- ie, periodically scan for Permissions errors in the rsyncd log and fix them.  This will not guarantee that mirrors will never get errors -- but as mirrors get errors, they will be automagically fixed.

Does that sound workable?

Thanks for caring.  Really.

Denis

_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors
Reply | Threaded
Open this post in threaded view
|

Re: (8422) rsync ERROR on 2012.11.30-15:48:16]

Carsten Otto-5
Hi,

On Thu, Apr 18, 2013 at 09:16:35AM -0400, Denis Roy wrote:
> On _our_ side, no.

OK. Since this means many warnings sent to me, I will ignore those
mails.

> We do not "care" because, if the project teams want users to download
> their bits, it will be quickly apparent that there is a problem and
> they will fix their permissions.

There are problems that are not related to permissions. Furthermore,
there are several ways to deal with permission errors without having
mirror admins see them.

> However, I do care about errors on _your_ side if _you_ care about
> errors on your side.

Good. Feel free to tell us when something goes wrong. I guess we will
not notice anymore because of the ignored mails from our scripts.

> I was under the assumption that most mirrors simply sent errors to
> /dev/null since, as above, if there were permissions problems, the
> onus is on us to fix them.

This may be true for most mirrors (although I doubt it), but it seems
very foolish to me. Error messages are meant to be read. As said, there
are more errors than permission errors.

> I've opened this bug: https://bugs.eclipse.org/bugs/show_bug.cgi?id=405981

Let's hope a good solution pops up. I suggest to have two repositories:

Eclipse developers push to Repo A and do what they want (permission-wise).
Repo B is mirrored from Repo A using hardlinks. Here a non-root user is
used to access the files, so that errors can be detected here.
Furthermore, there will be no inaccessible files in Rebo B. Repo B is
served to the public mirrors.

I think I mentioned this already...

Best regards,
--
Carsten Otto           [hidden email]
LuFG Informatik 2      http://verify.rwth-aachen.de/otto/
RWTH Aachen            phone: +49 241 80-21211

_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors

signature.asc (205 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: (8422) rsync ERROR on 2012.11.30-15:48:16]

Denis Roy
On 04/18/2013 11:14 AM, Carsten Otto wrote:
> I suggest to have two repositories: Eclipse developers push to Repo A
> and do what they want (permission-wise). Repo B is mirrored from Repo
> A using hardlinks. Here a non-root user is used to access the files,
> so that errors can be detected here. Furthermore, there will be no
> inaccessible files in Rebo B. Repo B is served to the public mirrors.
> I think I mentioned this already...

Fantastic!  Repo B is located here:

rsync --list-only rsync://rsync.osuosl.org/eclipse

or here:

rsync --list-only rsync://ftp.gtlib.gatech.edu/eclipse


I've removed your IP address from download.eclipse.org, since that is
Repo A.

I'm glad we were able to work this out!  Thanks for the suggestion.

Denis
_______________________________________________
eclipse-mirrors mailing list
[hidden email]
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors