[Eisfair] [CERT] cannot stat .... certs-update-crl-joblist
Marcus Roeckrath
marcus.roeckrath at gmx.de
Mi Jul 30 15:59:46 CEST 2014
Hallo Jürgen,
Juergen Edner wrote:
>> Ich vermute, dass nach dem stundenlangen Stillstand die
>> zwischenzeitlich aufgelaufenen Jobs zeitgleich nachgeholt wurden
>> und es dann zu einem Zugriffsproblem auf die certs-update-crl-joblist
>> kommt.
>
> dies ist ein interessanter Aspekt den ich bis dato noch keine Beachtung
> geschenkt habe. Es wäre in der Tat interessant zu erfahren, wie sich der
> atd verhält, wenn er Jobs findet deren Ausführungsdaten in der
> Vergangenheit liegen.
Ist etwas länger, aber das passiert, wenn der atd beim Boot gestartet wird;
viele Jobs parallel:
Jul 29 09:18:06 eis
certs-update-crl[2060]: /var/install/bin/certs-update-crl --quiet -single
http://crl.usertrust.com/UTN-USERFirst-Hardware.crl
Jul 29 09:18:06 eis
certs-update-crl[2094]: /var/install/bin/certs-update-crl --quiet -single
http://crl.serverpass.telesec.de/rl/TeleSec_ServerPass_DE-1.crl
Jul 29 09:18:06 eis
certs-update-crl[2055]: /var/install/bin/certs-update-crl --quiet -single
http://crl.comodoca.com/COMODOCertificationAuthority.crl
Jul 29 09:18:06 eis
certs-update-crl[2053]: /var/install/bin/certs-update-crl --quiet -single
http://crl.comodo.net/TrustedCertificateServices.crl
Jul 29 09:18:06 eis
certs-update-crl[2058]: /var/install/bin/certs-update-crl --quiet -single
http://crl.usertrust.com/UTN-USERFirst-ClientAuthenticationandEmail.crl
Jul 29 09:18:06 eis
certs-update-crl[2070]: /var/install/bin/certs-update-crl --quiet -single
http://www.trustcenter.de/crl/v2/tc_universal_root_I.crl
Jul 29 09:18:06 eis
certs-update-crl[2052]: /var/install/bin/certs-update-crl --quiet -single
http://crl.comodoca.com/SecureCertificateServices.crl
Jul 29 09:18:06 eis
certs-update-crl[2054]: /var/install/bin/certs-update-crl --quiet -single
http://crl.comodo.net/AAACertificateServices.crl
Jul 29 09:18:06 eis
certs-update-crl[2068]: /var/install/bin/certs-update-crl --quiet -single
http://www.trustcenter.de/crl/v2/tc_class0_L1_CA_XI.crl
Jul 29 09:18:06 eis
certs-update-crl[2073]: /var/install/bin/certs-update-crl --quiet -single
http://www.trustcenter.de/crl/v2/tc_class3_pki_admin_ca_II.crl
Jul 29 09:18:06 eis
certs-update-crl[2069]: /var/install/bin/certs-update-crl --quiet -single
http://crl.oces.certifikat.dk/oces.crl
Jul 29 09:18:06 eis
certs-update-crl[2047]: /var/install/bin/certs-update-crl --quiet -single
http://crl.netsolssl.com/NetworkSolutionsCertificateAuthority.crl
Jul 29 09:18:06 eis
certs-update-crl[2066]: /var/install/bin/certs-update-crl --quiet -single
http://crl.serverpass.telesec.de/rl/TeleSec_ServerPass_DE-2.crl
Jul 29 09:18:06 eis
certs-update-crl[2119]: /var/install/bin/certs-update-crl --quiet -single
http://crl.comodoca.com/TrustedCertificateServices.crl
Jul 29 09:18:07 eis
certs-update-crl[2127]: /var/install/bin/certs-update-crl --quiet -single
http://www.entrust.net/CRL/net1.crl
Jul 29 09:18:06 eis
certs-update-crl[2074]: /var/install/bin/certs-update-crl --quiet -single
http://www.disig.sk/ca/crl/ca_disig.crl
Jul 29 09:18:06 eis
certs-update-crl[2093]: /var/install/bin/certs-update-crl --quiet -single
http://crl.usertrust.com/UTN-DATACorpSGC.crl
Jul 29 09:18:06 eis
certs-update-crl[2059]: /var/install/bin/certs-update-crl --quiet -single
http://crl.comodo.net/SecureCertificateServices.crl
Jul 29 09:18:06 eis
certs-update-crl[2067]: /var/install/bin/certs-update-crl --quiet -single
http://www.trustcenter.de/crl/v2/tc_class_3_ca_II.crl
Jul 29 09:18:06 eis
certs-update-crl[2071]: /var/install/bin/certs-update-crl --quiet -single
http://www.trustcenter.de/crl/v2/tc_class_2_ca_II.crl
Jul 29 09:18:06 eis
certs-update-crl[2049]: /var/install/bin/certs-update-crl --quiet -single
http://crl.comodoca.com/AAACertificateServices.crl
Jul 29 09:18:06 eis
certs-update-crl[2065]: /var/install/bin/certs-update-crl --quiet -single
http://www.trustcenter.de/crl/v2/tc_class_0_ca_II.crl
Jul 29 09:18:06 eis
certs-update-crl[2057]: /var/install/bin/certs-update-crl --quiet -single
http://www.trustcenter.de/crl/v2/tc_class2_pki_admin_ca_II.crl
Jul 29 09:18:06 eis
certs-update-crl[2063]: /var/install/bin/certs-update-crl --quiet -single
http://crl.usertrust.com/UTN-USERFirst-Object.crl
Jul 29 09:18:06 eis certs-update-crl[2074]: - downloading
'http://www.disig.sk/ca/crl/ca_disig.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2055]: - downloading
'http://crl.comodoca.com/COMODOCertificationAuthority.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2054]: - downloading
'http://crl.comodo.net/AAACertificateServices.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2093]: - downloading
'http://crl.usertrust.com/UTN-DATACorpSGC.crl' ...
Jul 29 09:18:07 eis certs-update-crl[2127]: - downloading
'http://www.entrust.net/CRL/net1.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2068]: - downloading
'http://www.trustcenter.de/crl/v2/tc_class0_L1_CA_XI.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2094]: - downloading
'http://crl.serverpass.telesec.de/rl/TeleSec_ServerPass_DE-1.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2067]: - downloading
'http://www.trustcenter.de/crl/v2/tc_class_3_ca_II.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2053]: - downloading
'http://crl.comodo.net/TrustedCertificateServices.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2119]: - downloading
'http://crl.comodoca.com/TrustedCertificateServices.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2071]: - downloading
'http://www.trustcenter.de/crl/v2/tc_class_2_ca_II.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2058]: - downloading
'http://crl.usertrust.com/UTN-USERFirst-ClientAuthenticationandEmail.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2047]: - downloading
'http://crl.netsolssl.com/NetworkSolutionsCertificateAuthority.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2052]: - downloading
'http://crl.comodoca.com/SecureCertificateServices.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2049]: - downloading
'http://crl.comodoca.com/AAACertificateServices.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2070]: - downloading
'http://www.trustcenter.de/crl/v2/tc_universal_root_I.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2057]: - downloading
'http://www.trustcenter.de/crl/v2/tc_class2_pki_admin_ca_II.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2069]: - downloading
'http://crl.oces.certifikat.dk/oces.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2063]: - downloading
'http://crl.usertrust.com/UTN-USERFirst-Object.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2060]: - downloading
'http://crl.usertrust.com/UTN-USERFirst-Hardware.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2066]: - downloading
'http://crl.serverpass.telesec.de/rl/TeleSec_ServerPass_DE-2.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2065]: - downloading
'http://www.trustcenter.de/crl/v2/tc_class_0_ca_II.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2059]: - downloading
'http://crl.comodo.net/SecureCertificateServices.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2073]: - downloading
'http://www.trustcenter.de/crl/v2/tc_class3_pki_admin_ca_II.crl' ...
Jul 29 09:18:06 eis certs-update-crl[2073]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2060]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2070]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2049]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2053]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2055]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2057]: - converting CRL file to PEM
format ...
Jul 29 09:18:07 eis certs-update-crl[2127]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2094]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2093]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2066]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2058]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2047]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2059]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2052]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2071]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2054]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2067]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2063]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2068]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2065]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2119]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2074]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2066]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2057]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2070]: - updating CRL list ...
Jul 29 09:18:07 eis certs-update-crl[2127]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2054]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2047]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2068]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2055]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2065]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2052]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2071]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2067]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2119]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2058]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2049]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2093]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2094]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2059]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2053]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2060]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2073]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2063]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2074]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2060]: - job '3312' (2014-07-29
03:40->2014-08-02 03:40) updated.
Jul 29 09:18:06 eis certs-update-crl[2060]: url:
http://crl.usertrust.com/UTN-USERFirst-Hardware.crl
Jul 29 09:18:06 eis certs-update-crl[2055]: - job '3313' (2014-07-29
00:40->2014-08-01 20:40) updated.
Jul 29 09:18:06 eis certs-update-crl[2055]: url:
http://crl.comodoca.com/COMODOCertificationAuthority.crl
Jul 29 09:18:06 eis certs-update-crl[2068]: - job '3314' (2014-07-28
19:31->2014-08-04 19:48) updated.
Jul 29 09:18:06 eis certs-update-crl[2068]: url:
http://www.trustcenter.de/crl/v2/tc_class0_L1_CA_XI.crl
Jul 29 09:18:06 eis certs-update-crl[2049]: - job '3315' (2014-07-29
01:01->2014-08-01 20:40) updated.
Jul 29 09:18:06 eis certs-update-crl[2049]: url:
http://crl.comodoca.com/AAACertificateServices.crl
Jul 29 09:18:07 eis certs-update-crl[2127]: - job '3316' (2014-08-04 07:10)
created.
Jul 29 09:18:07 eis certs-update-crl[2127]: url:
http://www.entrust.net/CRL/net1.crl
Jul 29 09:18:06 eis certs-update-crl[2059]: - job '3319' (2014-08-01 20:40)
created.
Jul 29 09:18:06 eis certs-update-crl[2052]: - job '3320' (2014-08-01 20:40)
created.
Jul 29 09:18:06 eis certs-update-crl[2052]: url:
http://crl.comodoca.com/SecureCertificateServices.crl
Jul 29 09:18:06 eis certs-update-crl[2047]: - job '3318' (2014-08-01 20:40)
created.
Jul 29 09:18:06 eis certs-update-crl[2047]: url:
http://crl.netsolssl.com/NetworkSolutionsCertificateAuthority.crl
Jul 29 09:18:06 eis certs-update-crl[2059]: url:
http://crl.comodo.net/SecureCertificateServices.crl
Jul 29 09:18:06 eis certs-update-crl[2094]: - job '3321' (2014-07-29 19:06)
created.
Jul 29 09:18:06 eis certs-update-crl[2094]: url:
http://crl.serverpass.telesec.de/rl/TeleSec_ServerPass_DE-1.crl
Jul 29 09:18:06 eis certs-update-crl[2065]: - job '3322' (2014-08-04 20:09)
created.
Jul 29 09:18:06 eis certs-update-crl[2065]: url:
http://www.trustcenter.de/crl/v2/tc_class_0_ca_II.crl
Jul 29 09:18:06 eis certs-update-crl[2063]: - job '3317' (2014-07-29
01:10->2014-08-01 20:40) updated.
Jul 29 09:18:06 eis certs-update-crl[2063]: url:
http://crl.usertrust.com/UTN-USERFirst-Object.crl
Jul 29 09:18:06 eis certs-update-crl[2073]: - job '3323' (2014-08-04 19:48)
created.
Jul 29 09:18:06 eis certs-update-crl[2073]: url:
http://www.trustcenter.de/crl/v2/tc_class3_pki_admin_ca_II.crl
Jul 29 09:18:06 eis certs-update-crl[2057]: - job '3324' (2014-08-04 19:43)
created.
Jul 29 09:18:06 eis certs-update-crl[2057]: url:
http://www.trustcenter.de/crl/v2/tc_class2_pki_admin_ca_II.crl
Jul 29 09:18:06 eis certs-update-crl[2069]: - converting CRL file to PEM
format ...
Jul 29 09:18:06 eis certs-update-crl[2093]: - job '3325' (2014-08-01 20:40)
created.
Jul 29 09:18:06 eis certs-update-crl[2093]: url:
http://crl.usertrust.com/UTN-DATACorpSGC.crl
Jul 29 09:18:06 eis certs-update-crl[2055]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2054]: - job '3326' (2014-08-01 20:40)
created.
Jul 29 09:18:06 eis certs-update-crl[2054]: url:
http://crl.comodo.net/AAACertificateServices.crl
Jul 29 09:18:06 eis certs-update-crl[2068]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2049]: updating hashes ...
Jul 29 09:18:07 eis certs-update-crl[2127]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2058]: - job '3327' (2014-08-01 20:40)
created.
Jul 29 09:18:06 eis certs-update-crl[2058]: url:
http://crl.usertrust.com/UTN-USERFirst-ClientAuthenticationandEmail.crl
Jul 29 09:18:06 eis certs-update-crl[2052]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2094]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2047]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2059]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2065]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2063]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2060]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2073]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2057]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2093]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2054]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2058]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2071]: - job '3328' (2014-08-04 19:51)
created.
Jul 29 09:18:06 eis certs-update-crl[2071]: url:
http://www.trustcenter.de/crl/v2/tc_class_2_ca_II.crl
Jul 29 09:18:06 eis certs-update-crl[2071]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2066]: - job '3329' (2014-07-29 19:03)
created.
Jul 29 09:18:06 eis certs-update-crl[2066]: url:
http://crl.serverpass.telesec.de/rl/TeleSec_ServerPass_DE-2.crl
Jul 29 09:18:06 eis certs-update-crl[2066]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2067]: - job '3330' (2014-08-04 19:51)
created.
Jul 29 09:18:06 eis certs-update-crl[2067]: url:
http://www.trustcenter.de/crl/v2/tc_class_3_ca_II.crl
Jul 29 09:18:06 eis certs-update-crl[2067]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2069]: - updating CRL list ...
Jul 29 09:18:06 eis certs-update-crl[2119]: - job '3331' (2014-08-01 20:43)
created.
Jul 29 09:18:06 eis certs-update-crl[2119]: url:
http://crl.comodoca.com/TrustedCertificateServices.crl
Jul 29 09:18:06 eis certs-update-crl[2119]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2070]: - job '3332' (2014-08-04 19:46)
created.
Jul 29 09:18:06 eis certs-update-crl[2070]: url:
http://www.trustcenter.de/crl/v2/tc_universal_root_I.crl
Jul 29 09:18:06 eis certs-update-crl[2053]: - job '3333' (2014-08-01 20:43)
created.
Jul 29 09:18:06 eis certs-update-crl[2053]: url:
http://crl.comodo.net/TrustedCertificateServices.crl
Jul 29 09:18:06 eis certs-update-crl[2070]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2053]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2074]: - job '3334' (2014-07-30 09:02)
created.
Jul 29 09:18:06 eis certs-update-crl[2074]: url:
http://www.disig.sk/ca/crl/ca_disig.crl
Jul 29 09:18:06 eis certs-update-crl[2074]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2069]: - job '3335' (2014-07-29 21:14)
created.
Jul 29 09:18:06 eis certs-update-crl[2069]: url:
http://crl.oces.certifikat.dk/oces.crl
Jul 29 09:18:06 eis certs-update-crl[2069]: updating hashes ...
Jul 29 09:18:06 eis certs-update-crl[2074]: finished.
Jul 29 09:18:06 eis certs-update-crl[2071]: finished.
Jul 29 09:18:06 eis certs-update-crl[2067]: finished.
Jul 29 09:18:06 eis certs-update-crl[2119]: finished.
Jul 29 09:18:06 eis certs-update-crl[2065]: finished.
Jul 29 09:18:06 eis certs-update-crl[2058]: finished.
Jul 29 09:18:06 eis certs-update-crl[2066]: finished.
Jul 29 09:18:06 eis certs-update-crl[2073]: finished.
Jul 29 09:18:06 eis certs-update-crl[2057]: finished.
Jul 29 09:18:06 eis certs-update-crl[2047]: finished.
Jul 29 09:18:06 eis certs-update-crl[2093]: finished.
Jul 29 09:18:06 eis certs-update-crl[2053]: finished.
Jul 29 09:18:06 eis certs-update-crl[2054]: finished.
Jul 29 09:18:06 eis certs-update-crl[2069]: finished.
Jul 29 09:18:06 eis certs-update-crl[2070]: finished.
Jul 29 09:18:07 eis certs-update-crl[2127]: finished.
Jul 29 09:18:06 eis certs-update-crl[2059]: finished.
Jul 29 09:18:06 eis certs-update-crl[2055]: finished.
Jul 29 09:18:06 eis certs-update-crl[2063]: finished.
Jul 29 09:18:06 eis certs-update-crl[2094]: finished.
Jul 29 09:18:06 eis certs-update-crl[2052]: finished.
Jul 29 09:18:06 eis certs-update-crl[2049]: finished.
Jul 29 09:18:06 eis certs-update-crl[2060]: finished.
Jul 29 09:18:06 eis certs-update-crl[2068]: finished.
Keine Ahnung, wie man das auflösen soll, aber das certs-update-crl-Script
darf nicht parallel mehrfach laufen.
Vielleicht eine Semaphore setzen (so habe ich es in einem nicht mehrfach
laufen dürfenden cgi-Script gelöst)?
# Semaphore existiert aber es gibt keinen Prozeß dazu, also weg
if [ -f ${semaphore} ] ; then
if [ `ps ax | grep -v grep | grep -c "${0}"` = 2 ] ; then
rm -f ${semaphore}
fi
fi
if [ ! -f ${semaphore} ] ; then
touch ${semaphore}
# und das Script arbeitet
rm ${semaphore}
else
# sofortiger Abbruch
# definierte Warteschleife mit Abbruch
# definierte Warteschleife mit Prüfung (siehe oben)
# oder ...
# wenn semaphore weg dann
touch ${semaphore}
# und das Script arbeitet
rm ${semaphore}
fi
Nur so eine Idee.
--
Gruss Marcus
Mehr Informationen über die Mailingliste Eisfair