Update llm usecase with easy setting #1443
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
`
[llmServer] Starting LLM service in the background...
[llmServer] Checking status of the LLM service...
[llmServer] LLM service is running. PID: 36673
[llmServer] Showing the last 20 lines of the log file (llmServer.log):
[Test: replace localhost with IP address of the server]
curl -X POST http://localhost:5001/query -H "Content-Type: application/json" -d '{"prompt": "What is the Multi-Cloud?"}'
http://localhost:5001/query?prompt=What is the Multi-Cloud?
`
`
cb-user@ip-10-11-10-23:~/llm$ curl -X POST http://localhost:5001/query -H "Content-Type: application/json" -d '{"prompt": "What is the Multi-Cloud?"}'
{"text":" Multi-cloud is the practice of using multiple cloud computing platforms or services from different providers to store and process data. This is often used as a backup or redundancy strategy to ensure data is not lost in case of a system failure or downtime."}
`