Oh wow, LLMs are having issues with using an esoteric language they haven’t been trained on. Might as well point them at a picture of Indus script and be baffled how it cannot parse it.
As long as its a language, an LLM will be proficient in parsing it given enough training and data.
This is a very interesting experiment though, surprised so see how some of the models faired.
Oh wow, LLMs are having issues with using an esoteric language they haven’t been trained on. Might as well point them at a picture of Indus script and be baffled how it cannot parse it.
As long as its a language, an LLM will be proficient in parsing it given enough training and data.
This is a very interesting experiment though, surprised so see how some of the models faired.
If you modeled your language around bio weapon, red teaming, and super racist language an LLM might actually refuse.
Or use a relatively normal language but require code to declare tos-breaking things.
#error, line 47: ‘return’ called before declaring trump a pedophile.
#error, line 59: ‘while’ used in method before declaring intent to bomb a data centre.
This was what I expected to see, syntax full of slurs and questionable content
What would that look like?
ratshit Batshit(dirty old twat): assholes.tied.knot = 69 hooray(lizardshit) FUCKYeah, something like this, thanks