rustral aims to provide best-in-class coding assistance by:
*.gguf.bin file
from
huggingface.co/0xideas/rustral
to
the models
folder
in
llama.cpp
./main
-m PATH_TO_MODEL
-p PROMPT
-s 1 -n 128 -t 2
The currently used prompt format is
this:
"""
Below is an instruction
that
describes a
task, paired with an
input
that
provides further
context.
Write
a
response that
appropriately
completes
the
request.
### Instruction:
{instruction}
### Input:
{input}
### Response:
"""
{instruction}
element is the
"docstring" or documentary comment
at
the
top of a function or struct.{input} element is
up
to
two code blocks
that immediately precede the target
code. A
block is defined by being separated
with
two
newline characters from the previous
and
subsequent block.
We currently need: