Reported by kmaclean, 5 years ago.

One of the scripts in the acoustic model creation process (WavTools?.pm) reads the first two seconds of a speech audio file to calculate the sample mean.

However, undefined sample errors can occur when the audio file is less than 2 seconds long.

Reported by kmaclean, 6 years ago.

error in logs:

Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT ()
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (svn: E155036: Please see the 'svn upgrade' command)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (svn: E155036: The working copy at '/data/svn-mirror/de/Trunk')
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (is too old (format 29) to work with client version '1.8.10 (r1615264)' (expects format 31). You need to upgrade the working copy first.)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT ()
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (Uncaught exception from user code:)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (        "svn add /data/svn-mirror/de/Trunk/Audio/Original/48kHz_16bit/anonymous-20141217-xjj" unexpectedly returned exit value 1 at lib/Corpus/Repository.pm line 404.)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (        IPC::System::Simple::_check_exit('svn add /data/svn-mirror/de/Trunk/Audio/Original/48kHz_16bit/...', 1, 'ARRAY(0x59db938)') called at /usr/share/perl5/vendor_perl/IPC/System/Simple.pm line 538)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (        IPC::System::Simple::_process_child_error(256, 'svn add /data/svn-mirror/de/Trunk/Audio/Original/48kHz_16bit/...', 'ARRAY(0x59db938)') called at /usr/share/perl5/vendor_perl/IPC/System/Simple.pm line 233)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (        IPC::System::Simple::capture('svn add /data/svn-mirror/de/Trunk/Audio/Original/48kHz_16bit/...') called at lib/Corpus/Repository.pm line 404)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (        Corpus::Repository::_updateSVN('Corpus::Repository=HASH(0x5750560)') called at lib/Corpus/Repository.pm line 196)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (        Corpus::Repository::process('Corpus::Repository=HASH(0x5750560)') called at lib/Corpus/Repository.pm line 125)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (        Corpus::Repository::BUILD('Corpus::Repository=HASH(0x5750560)', 'HASH(0x56fa0a8)') called at /usr/local/lib64/perl5/Class/MOP/Method.pm line 124)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (        Class::MOP::Method::execute('Moose::Meta::Method=HASH(0x5833f80)', 'Corpus::Repository=HASH(0x5750560)', 'HASH(0x56fa0a8)') called at /usr/local/lib64/perl5/Moose/Object.pm line 53)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (        Moose::Object::BUILDALL('Corpus::Repository=HASH(0x5750560)', 'HASH(0x56fa0a8)') called at /usr/local/lib64/perl5/Moose/Meta/Class.pm line 278)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (        Moose::Meta::Class::new_object('Moose::Meta::Class=HASH(0x3c90bc0)', 'HASH(0x56fa0a8)') called at /usr/local/lib64/perl5/Moose/Object.pm line 24)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (        Moose::Object::new('Corpus::Repository', 'HASH(0x57504b8)') called at ./VoxForge.pm line 135)
Dec 29 01:00:52 finch.localdomain CROND[11272]: (kmaclean) CMDOUT (        VoxForge::process('VoxForge=HASH(0x56f5d48)') called at ./VoxForge.pm line 175)

Reported by kmaclean, 6 years ago.

subversion:

when trying

# svnadmin verify /data/svnroot/svn/es

this command would verify everything was OK from version 1 to 1116 and then die with this error:

can't open file ... Input/Output error

looking at /data/svnroot/svn/es/db/revprops and revisions with nautilus, only revisions 1 to 1115 would display

looking at same folders from command line (using ls) showed all the revision files, but problems with folders 1116 to 1163.

turned out to be a bad sector on the ssd used in prod - however SMART data shows no errors - not a very comforting indicator... will monitor.

These were the steps taken to correct things:

1. on the web server/subversion server
turn off webgui & httpd
turnoff webgui monitor in crontab

2. set runlevel to 1
# init 1

3a. unmount all regular and bind mounts from the ssd drive
# umount /data
# umount /mnt/birch
# blkid   # to confirm drive id

3b. check disk
# fsck /dev/sdc
(same problem folders in svn show up here... fsck cleans these up)
# fsck   # to confirm verything was cleaned up
# reboot

4. backup spanish repository
# tar -zcvf  es_backup  /data/svnroot/es

5. get last good backup: July 1,2014 - why subversion allowed commits for all this time is beyond me... 

6. get a dump file of versions from July 1:
# svnadmin dump --incremental -r 8212:8787 /data/svnroot/svn/es > svndump

7. rename old /data/svnroot/svn/es folder to /data/svnroot/svn/es_bad_dec9_2014

8. extract last good backup to /data/svnroot/svn/es

9. load versions from last good backup to present into es (from backup)
# svnadmin load /data/svnroot/svn/es < svndump

10. verify that repository has been fixed
# svnadmin verify /data/svnroot/svn/es

(verified revisions 1 to 8787 - everything OK)

11. restart httpd & webgui

12. restore password file in /data/svnroot/svn/es/conf 
(does not get backed up)