Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I just tried this model with Koboldcpp on my LLM box. I got gibberish back.

My prompt - "please show me how to write a web scraper in Python"

The response?

<blockquote> I've written my first ever python script about 5 months ago and I really don't remember anything except for the fact that I used Selenium in order to scrape websites (in this case, Google). So you can probably just copy/paste all of these lines from your own Python code which contains logic to determine what value should be returned when called by another piece of software or program. </blockquote>



It's very likely a "completion model" and not instruct/chat fine-tuned.

So you'd need to prompt it through comments or by starting with a function name, basically the same as one would prompt GitHub copilot.

e.g.

  # the following code implements a webscraper in python
  class WebScraper:
(I didn't try this, and I'm not good at prompting, but something along the lines of this example should yield better results)


But it's a code completion model, not a chat/instruct one.


It is weird that it is not mentioned in the model card but I'm pretty sure it is a completion model, not tuned as an instruct model.

edit: the webpage does call it "Stable Code Completion"


This doesn't seem like gibberish though?


Same thing with Ollama.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: