Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docker #7

Closed
wants to merge 123 commits into from
Closed
Changes from 1 commit
Commits
Show all changes
123 commits
Select commit Hold shift + click to select a range
3dd259b
[infra] docker images automatically using gh (#4782)
jtrmal Aug 18, 2022
4592c54
[infra] add cpu-only docker build (#4783)
jtrmal Aug 18, 2022
0fb502d
Fix: ali-to-post piping in post-to-tacc example (#4788)
Agrover112 Aug 28, 2022
a754c18
[scripts] Copy utt2lang in copy_data_dir.sh (#4789)
jonghwanhyeon Aug 31, 2022
7bc53ef
[scripts] Move otherwise misleading comment in mkgraph.sh (#4787)
taku-takamatsu Sep 1, 2022
de3632d
Insert build system changes.
sfantao Sep 7, 2022
64c2754
Remove extra quote.
sfantao Sep 7, 2022
ee18146
Add hipify header.
sfantao Sep 8, 2022
fd48017
Add more entries to hipificatiion header to deal with the BLAS routines.
sfantao Sep 8, 2022
07f2f36
Cudmatrix hipification complete.
sfantao Sep 8, 2022
fde6f7f
Ignore Eclipse synchronized project files.
sfantao Sep 9, 2022
21ca60d
Hipify complete including NVTX.
sfantao Sep 9, 2022
1040234
Format files for the hipification.
sfantao Sep 9, 2022
801115d
Add hipification entries dropped by mistake.
sfantao Sep 9, 2022
081de1e
Change IS_GPU_ENABLED to IS_GPU_BUILD in depends build.
sfantao Sep 12, 2022
00098bf
Add build logic for ROCm < 5.2.0.
sfantao Sep 12, 2022
9b8dffb
Complete ROCm 5.0.2 build with no per-thread streams yet.
sfantao Sep 12, 2022
e84d8f0
Add cudadecoder support for ROCm 5.2.x.
sfantao Sep 13, 2022
aed0ce5
Complete support for ROCm 5.0.2.
sfantao Sep 13, 2022
727e454
[egs] Kill feral dupes of --num-threads in few local eg scripts (#4792)
bofenghuang Sep 14, 2022
299dadc
change [utter] to [utterance.] in data_prep.dox (#4795)
npovey Sep 20, 2022
716f558
Provide provision to pass subword separator as argument to make_posit…
kavyamanohar Sep 20, 2022
f6f4cca
Update run_blstm.sh (#4790)
xu-gaopeng Sep 26, 2022
99101e8
Do not use ADL to invoke std::binary_search
georgthegreat Dec 6, 2022
a023f3f
SRILM: allow bypassing download/extraction during automated installation
daanzu Dec 11, 2022
be22248
[src] Make word alignment optional (#4802)
galv Dec 13, 2022
aa17817
Fix variable name (#4815)
csetanmayjain Dec 26, 2022
0785b66
Add support for CUDA 12 and Hopper.
galv Jan 5, 2023
ae8cbe8
[misc] Install python2.7
galv Dec 13, 2022
8c3c0bc
Update install_srilm.sh
Neimhin Jan 20, 2023
e4eb4f6
egs/ami: Fix BUT path to wavs in AMI scripts, add beamformer config (…
KarelVesely84 Feb 3, 2023
561d8c2
Merge pull request #4809 from georgthegreat/patch-1
danpovey Feb 18, 2023
ab6c168
Merge pull request #4810 from daanzu/pr/srilm
danpovey Feb 18, 2023
ed910d6
Fix -Wdeprecated-copy from c++11
georgthegreat Feb 18, 2023
362ecc2
Merge pull request #4825 from georgthegreat/patch-2
danpovey Feb 18, 2023
59299d1
Fix for issue#4801 (#4826)
yfyeung Feb 20, 2023
ab8fa9e
No need for atomicAdd for float2, conflicts with CUDA 12.1 (#4838)
nshmyrev Apr 17, 2023
9a8588a
More fixes of unwanted ADL usage of std algos (#4828)
georgthegreat Apr 26, 2023
1918508
Fix matrix data offset for large matrices (#4823)
nshmyrev Apr 26, 2023
40fa148
Add recipe of Tibetan Amdo dialect
sendream Apr 27, 2023
3947a4b
Modify code to conform to ShellCheck specifications
sendream Apr 27, 2023
cbc7284
Modify code to conform to ShellCheck specifications
sendream Apr 27, 2023
0d7f17f
Fix download location in install_liblbfgs.sh
danpovey May 2, 2023
5ef3962
Merge
danpovey May 2, 2023
71f38e6
Merge pull request #4850 from danpovey/fix_liblbfgs
danpovey May 2, 2023
039ccbf
[egs] convert tuple to NDArray before call sklearn.manifold.TSNE
BaffinLee May 5, 2023
f5805db
Create Dockerfile
wshilton Aug 11, 2023
745c6e1
Update Dockerfile
wshilton Aug 11, 2023
ebf6245
Update Dockerfile
wshilton Aug 12, 2023
aef1d98
Update install_mkl.sh
culhatsker Oct 13, 2023
1b07b59
Merge pull request #4875 from culhatsker/mkl_install_update
danpovey Oct 13, 2023
be4ace5
Merge branch 'old-mydev' into mydev
sfantao Oct 19, 2023
6d8dd4c
Fix __CUDA_ARCH__ issue and add more hipification.
sfantao Oct 20, 2023
3a8896c
Fix LatticeSimpleDecoder
csukuangfj Nov 1, 2023
cdbc05b
Fixes to work with CUDA 12 toolkit
Nov 3, 2023
a670447
Merge pull request #4880 from danpovey/cuda_fixes
danpovey Nov 3, 2023
fe12720
Openblas repo was renamed
nshmyrev Nov 4, 2023
f584420
Fix tests with zero size matrices and needing syncwarp for LDS sharing.
sfantao Nov 6, 2023
7dc4dd1
Merge remote-tracking branch 'origin/master' into amd-dev
sfantao Nov 6, 2023
ba4e18f
Move misplaced #pragma unroll.
sfantao Nov 6, 2023
dac0b27
Working version trimmed of legacy ROCm < 5.2 code.
sfantao Nov 6, 2023
0018fec
Fix formating to Google style.
sfantao Nov 6, 2023
3aaa326
Fix more formating to Google style.
sfantao Nov 7, 2023
6ebab70
Fix header ordering.
sfantao Nov 7, 2023
7efdeae
Add GPU characteristics for CUDA.
sfantao Nov 7, 2023
700bf93
[tools] Replace uses of Python distutils
eginhard Nov 9, 2023
cd2b835
Fix #4870, spurious error in ProcessNonemitting; queue can validly be…
danpovey Nov 10, 2023
e187518
Merge pull request #4885 from danpovey/fix_simple_decoder2
danpovey Nov 10, 2023
829e8d6
Merge branch 'master' into fix-lattice-simple-decoder
danpovey Nov 10, 2023
49faa67
Merge pull request #4879 from csukuangfj/fix-lattice-simple-decoder
danpovey Nov 10, 2023
e8ed610
Merge pull request #4882 from sfantao/amd-dev
danpovey Nov 10, 2023
e97d353
Update fix_data_dir.sh
teinhonglo Nov 13, 2023
0d12885
Merge pull request #4881 from alphacep/openblas-repo-rename
danpovey Nov 13, 2023
b488400
Merge pull request #4886 from teinhonglo/master
danpovey Nov 13, 2023
bf248aa
Merge pull request #4866 from wshilton/wshilton-add-dockerfile-for-ub…
danpovey Nov 13, 2023
a611d7b
Merge pull request #4883 from eginhard/distutils
danpovey Nov 13, 2023
545b1f1
Merge pull request #4851 from BaffinLee/fix/fix-gop-visualize-error
danpovey Nov 13, 2023
21ae411
Merge pull request #4847 from sendream/master
danpovey Nov 13, 2023
3675219
Merge branch 'master' into patch-1
danpovey Nov 13, 2023
b7e886c
Update COPYING
Omerdan03 Dec 14, 2023
77ffb55
Fix unused but set variable
dzen03 Jan 21, 2024
f785fa0
configure: Fix gcc version check for cuda
rfehren Jan 29, 2024
8c451e2
Merge pull request #4905 from Q-Leap-Networks/master
danpovey Jan 31, 2024
a74256f
Workaround for macOS bug with strdup (fixes #4855)
pguyot Apr 30, 2024
a979f2a
Patch sctk for macOS picky compiler
pguyot Apr 30, 2024
f495ac7
Merge pull request #4902 from dzen03/fix-unused-variable
danpovey Apr 30, 2024
02558cc
Merge pull request #4891 from Omerdan03/patch-1
danpovey Apr 30, 2024
e57be0d
Merge pull request #4911 from pguyot/w18/fix-macos-sctk-strdup
danpovey Apr 30, 2024
ad88b3b
Merge pull request #4912 from pguyot/w18/fix-stck-includes-and-defini…
danpovey Apr 30, 2024
51744d3
Merge pull request #4818 from Neimhin/patch-1
danpovey Apr 30, 2024
f328393
Fix missing FLT_MAX in some CUDA installation scenarios.
danijel3 Jun 2, 2024
67548a3
Merge pull request #4917 from danijel3/master
danpovey Jun 3, 2024
c4515b0
Fix reported issues w.r.t python2.7 and some apple silicone quirks
jtrmal Jul 22, 2024
ed29e16
catch exception by reference so that compiler does not complain
jtrmal Jul 22, 2024
4145e17
fix tests and address comments
jtrmal Jul 23, 2024
38ea2b1
disable warning about unused flags msse and msse on Apple Silicon
jtrmal Jul 23, 2024
3cf3c1a
do a full cleanup on apple silicon
jtrmal Jul 23, 2024
770daa2
improve compatibility with C++ standard, esp. C++20
jtrmal Jul 23, 2024
816d438
make codefactor happier
jtrmal Jul 23, 2024
6f61393
Merge pull request #4924 from jtrmal/python_and_apple
danpovey Jul 23, 2024
3f170d4
Support openfst-1.7.6
georgthegreat Feb 23, 2023
e460d8a
Support openfst-1.8.0
georgthegreat Feb 23, 2023
5ccce55
Support openfst-1.8.1
georgthegreat Feb 23, 2023
9a213be
Support openfst-1.8.2
georgthegreat Feb 23, 2023
122a3f2
make nonconst catches const (#4926)
jtrmal Jul 25, 2024
57efb6b
add support for later openfst versions
jtrmal Jul 25, 2024
a7fcc2d
fix the non-compiling tests, thx to @csukuangfj
jtrmal Jul 25, 2024
13441d0
Merge pull request #4927 from jtrmal/openfst-1.8.2
danpovey Sep 8, 2024
967be48
upgraded docker build and github pipeline
jtrmal Sep 11, 2024
b5ed933
modify the gh action triggers
jtrmal Sep 11, 2024
42d40c6
modify the gh action triggers
jtrmal Sep 11, 2024
f43be33
test
jtrmal Sep 11, 2024
9cbe2f9
fix error
jtrmal Sep 11, 2024
6556085
upgrade actions
jtrmal Sep 11, 2024
b194fd0
fix build flag
jtrmal Sep 11, 2024
11b25c3
fix build flag
jtrmal Sep 11, 2024
505ae59
fix issues
jtrmal Sep 11, 2024
17599b7
fix issues
jtrmal Sep 11, 2024
407cd50
add mkl
jtrmal Sep 11, 2024
b55e546
fix cuda builds
jtrmal Sep 11, 2024
f4112d7
fix cuda builds
jtrmal Sep 11, 2024
e31abf0
trying to solve docker image size
jtrmal Sep 12, 2024
961c06b
trying to solve docker image size
jtrmal Sep 12, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
SRILM: allow bypassing download/extraction during automated installation
  • Loading branch information
daanzu committed Dec 11, 2022
commit a023f3fe56c0c43f7be5a6086f0cc1067aeebeae
47 changes: 29 additions & 18 deletions tools/extras/install_srilm.sh
Original file line number Diff line number Diff line change
Expand Up @@ -16,30 +16,41 @@ fi
! command -v gawk > /dev/null && \
echo "GNU awk is not installed so SRILM will probably not work correctly: refusing to install" && exit 1;

if [ $# -ne 3 ]; then
echo "SRILM download requires some information about you"
echo
echo "Usage: $0 <name> <organization> <email>"
exit 1
fi

srilm_url="http://www.speech.sri.com/projects/srilm/srilm_download.php"
post_data="WWW_file=srilm-1.7.3.tar.gz&WWW_name=$1&WWW_org=$2&WWW_email=$3"

if ! wget --post-data "$post_data" -O ./srilm.tar.gz "$srilm_url"; then
echo 'There was a problem downloading the file.'
echo 'Check you internet connection and try again.'
exit 1
if [ ! -f srilm.tgz ] && [ ! -f srilm.tar.gz ] && [ ! -d srilm ]; then
if [ $# -ne 3 ]; then
echo "SRILM download requires some information about you"
echo
echo "Usage: $0 <name> <organization> <email>"
exit 1
fi

srilm_url="http://www.speech.sri.com/projects/srilm/srilm_download.php"
post_data="WWW_file=srilm-1.7.3.tar.gz&WWW_name=$1&WWW_org=$2&WWW_email=$3"

if ! wget --post-data "$post_data" -O ./srilm.tar.gz "$srilm_url"; then
echo 'There was a problem downloading the file.'
echo 'Check your internet connection and try again.'
exit 1
fi

if [ ! -s srilm.tar.gz ]; then
echo 'The file is empty. There was a problem downloading the file.'
exit 1
fi
fi

mkdir -p srilm
cd srilm


if [ -f ../srilm.tgz ]; then
tar -xvzf ../srilm.tgz # Old SRILM format
elif [ -f ../srilm.tar.gz ]; then
tar -xvzf ../srilm.tar.gz # Changed format type from tgz to tar.gz
tar -xvzf ../srilm.tgz || exit 1 # Old SRILM format
elif [ -f ../srilm.tar.gz ]; then
tar -xvzf ../srilm.tar.gz || exit 1 # Changed format type from tgz to tar.gz
fi

if [ ! -f RELEASE ]; then
echo 'The file RELEASE does not exist. There was a problem extracting.'
exit 1
fi

major=`gawk -F. '{ print $1 }' RELEASE`
Expand Down