Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Python Deployment of Triton Inference Server #7501

Merged
merged 98 commits into from
Aug 30, 2024
Merged

feat: Python Deployment of Triton Inference Server #7501

Changes from 1 commit
Commits
Show all changes
98 commits
Select commit Hold shift + click to select a range
c9de538
Basic Interface and Bindings
KrishnanPrash Jul 3, 2024
a5bb38f
testing
KrishnanPrash Jul 8, 2024
2215e58
Adding stuff
KrishnanPrash Jul 13, 2024
c450c0d
Working MVP for wheel
KrishnanPrash Jul 20, 2024
aab5e82
Remove _deps
KrishnanPrash Jul 20, 2024
6c2d9b2
Working MVP (No linking issues)
KrishnanPrash Jul 22, 2024
819262f
Working server HTTP bindings
KrishnanPrash Jul 23, 2024
7a141b7
Not working pybind->dict stuff
KrishnanPrash Jul 25, 2024
62ce8db
Get logic not working
KrishnanPrash Jul 25, 2024
d388614
Update
KrishnanPrash Jul 29, 2024
47bde5b
GRPC basic working
KrishnanPrash Jul 30, 2024
ff2c919
Working http and grpc frontends
KrishnanPrash Aug 3, 2024
a7d17bd
Removing unecessary changes
KrishnanPrash Aug 5, 2024
06147cd
Adding testing and cleaning up code
KrishnanPrash Aug 5, 2024
d35dce4
Adding/Updating copyright
KrishnanPrash Aug 5, 2024
fc40f50
removing extra space
KrishnanPrash Aug 5, 2024
ca29a19
spacing
KrishnanPrash Aug 5, 2024
44c81b7
Adding back CMake compile_feature
KrishnanPrash Aug 5, 2024
745ff6a
modify cmake
KrishnanPrash Aug 5, 2024
bf6f871
Removing print statements
KrishnanPrash Aug 5, 2024
b30ced3
Extra spacing
KrishnanPrash Aug 5, 2024
30067a8
Formatting
KrishnanPrash Aug 5, 2024
33afc53
Running pre-commit
KrishnanPrash Aug 5, 2024
ef1f602
Updates
KrishnanPrash Aug 5, 2024
554ed4a
Standardizing function names
KrishnanPrash Aug 5, 2024
2de88e2
Fixing potential file handling error
KrishnanPrash Aug 5, 2024
de734bd
fixing order of output arguments
KrishnanPrash Aug 6, 2024
c412a60
Removing unecessary code/Standardizing
KrishnanPrash Aug 7, 2024
95ceb33
Changing shared_ptr deleter name
KrishnanPrash Aug 7, 2024
e1548cb
Cleaning up CMake
KrishnanPrash Aug 7, 2024
ff2a6e9
Removing unecessary code / fixing function names
KrishnanPrash Aug 7, 2024
22cc785
Working Triton-specfic Error Handling
KrishnanPrash Aug 7, 2024
ccabc08
Removing unused import
KrishnanPrash Aug 7, 2024
879d3da
Migrating from Custom Validation to Pydantic
KrishnanPrash Aug 8, 2024
f3f3a1d
Error checking added to get_value<T>()
KrishnanPrash Aug 8, 2024
d538f13
Working test suite and Error Handling
KrishnanPrash Aug 12, 2024
89a59ca
Moved CMake instructions
KrishnanPrash Aug 12, 2024
a76cc19
Removed unused import
KrishnanPrash Aug 12, 2024
42d34ec
Working logging
KrishnanPrash Aug 13, 2024
1971215
Update src/common.h
KrishnanPrash Aug 13, 2024
70b80a3
Consistent returns
KrishnanPrash Aug 13, 2024
21bb999
streamlined client
KrishnanPrash Aug 13, 2024
fc9a7f4
Adding const
KrishnanPrash Aug 13, 2024
c14febd
Broken CMake
KrishnanPrash Aug 15, 2024
c25162b
Merge branch 'kprashanth-python-deployment' of https://github.com/tri…
KrishnanPrash Aug 15, 2024
a704589
Working CMake
KrishnanPrash Aug 16, 2024
45089b3
Working variant
KrishnanPrash Aug 16, 2024
47e207f
updates to CMake and core bindings
KrishnanPrash Aug 16, 2024
25cf153
Merge remote-tracking branch 'origin/main' into kprashanth-python-dep…
KrishnanPrash Aug 16, 2024
0c8d5d4
Cleaning up Repo
KrishnanPrash Aug 18, 2024
1a830d2
moved test cases
KrishnanPrash Aug 18, 2024
c90255f
change log verbose
KrishnanPrash Aug 19, 2024
fc273eb
revisions
KrishnanPrash Aug 19, 2024
52c6b61
Updated `README.md`
KrishnanPrash Aug 19, 2024
76e199a
Conditional inclusion of tracer.cc
KrishnanPrash Aug 20, 2024
2c57e71
Removed redundancy to CMakeLists.txt
KrishnanPrash Aug 20, 2024
3fac830
Fixing spelling mistake
KrishnanPrash Aug 20, 2024
ca8f717
Merge branch 'kprashanth-python-deployment' of https://github.com/tri…
KrishnanPrash Aug 20, 2024
c02ee75
Reverting unnecessary changes
KrishnanPrash Aug 20, 2024
35b606f
Completed test suite
KrishnanPrash Aug 20, 2024
448e6b4
Add check for HTTP and gRPC endpoint flags
KrishnanPrash Aug 21, 2024
0f765e8
Documentation and comments
KrishnanPrash Aug 21, 2024
d7b5c6b
Update src/python/README.md
KrishnanPrash Aug 21, 2024
83c4ee8
removing unecessary comments
KrishnanPrash Aug 21, 2024
a16d23e
Adding build instructions
KrishnanPrash Aug 21, 2024
8fb3cae
Using CMake generator expressions and adding LICENSE.txt to python whl
KrishnanPrash Aug 21, 2024
cff480d
Making examples and README.md more user-friendly
KrishnanPrash Aug 21, 2024
5247dbc
Removing unused import
KrishnanPrash Aug 21, 2024
10dafdf
tritonfrontend stubs generated
KrishnanPrash Aug 21, 2024
a4c5bd3
Removing comment
KrishnanPrash Aug 21, 2024
5a83f7c
Update CMakeLists.txt
KrishnanPrash Aug 21, 2024
6bf3c10
Update qa/L0_python_api/test_kserve_frontend.py
KrishnanPrash Aug 21, 2024
d762af1
Update src/common.h
KrishnanPrash Aug 21, 2024
4c74272
updates
KrishnanPrash Aug 25, 2024
8b33c1c
Update Dockerfile.QA
KrishnanPrash Aug 26, 2024
1d07314
fixing
KrishnanPrash Aug 26, 2024
9e540ec
updated CMake messaging
KrishnanPrash Aug 26, 2024
609c151
updated testing
KrishnanPrash Aug 27, 2024
a8ab882
Revamped error handling and test suite
KrishnanPrash Aug 28, 2024
3025f1a
cleaning up error handling
KrishnanPrash Aug 28, 2024
0cedd48
Minor changes
KrishnanPrash Aug 28, 2024
c904300
Adding static decorator
KrishnanPrash Aug 28, 2024
a7a7f58
Attempting to fix faulty pip install for tritonfrontend wheel
KrishnanPrash Aug 28, 2024
ef3197e
Reverting to previous pip install command
KrishnanPrash Aug 28, 2024
0ead5fc
Adding comments
KrishnanPrash Aug 28, 2024
f92e270
comments and copyright
KrishnanPrash Aug 28, 2024
5c7cd0d
cleaning up
KrishnanPrash Aug 28, 2024
86ba0fd
updating filename in bash script
KrishnanPrash Aug 28, 2024
57d441e
updating filename in bash script
KrishnanPrash Aug 28, 2024
79e67db
refactoring tests and moving docs
KrishnanPrash Aug 28, 2024
74e8193
Making function name consistent
KrishnanPrash Aug 28, 2024
94062b1
Making parameter names more descriptive
KrishnanPrash Aug 28, 2024
4625935
Removing redundant code
KrishnanPrash Aug 28, 2024
e87930f
Removing unnecessary use of
KrishnanPrash Aug 28, 2024
4ca394b
Merge branch 'kprashanth-python-deployment' of https://github.com/tri…
KrishnanPrash Aug 28, 2024
69bd5d3
updates to Readme.md
KrishnanPrash Aug 28, 2024
0d34f60
Merge branch 'main' into kprashanth-python-deployment
KrishnanPrash Aug 29, 2024
d95527a
update parameter names
KrishnanPrash Aug 29, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Adding back CMake compile_feature
  • Loading branch information
@KrishnanPrash
KrishnanPrash committed Aug 5, 2024
commit 44c81b72f91de7112451d03dddd3fe79336b5eb8
3 changes: 2 additions & 1 deletion src/CMakeLists.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -362,7 +362,8 @@ if(${TRITON_ENABLE_HTTP}
http-endpoint-library EXCLUDE_FROM_ALL
${HTTP_ENDPOINT_SRCS} ${HTTP_ENDPOINT_HDRS}
)


target_compile_features(http-endpoint-library PRIVATE cxx_std_${TRITON_MIN_CXX_STANDARD})
if(CMAKE_CXX_COMPILER_ID STREQUAL "MSVC")
target_compile_options(
http-endpoint-library
Expand Down
Loading