Affected by 
Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type LLM ¶
type LLM struct {
base.SingleThread
// contains filtered or unexported fields
}
func (*LLM) Embeddings ¶
func (llm *LLM) Embeddings(opts *pb.PredictOptions) ([]float32, error)
func (*LLM) PredictStream ¶
func (llm *LLM) PredictStream(opts *pb.PredictOptions, results chan string) error
Source Files
Click to show internal directories.
Click to hide internal directories.