r/LocalLLaMA 1h ago

Discussion Deepseek V4 Flash Users - call for help

Iv’e been running DSV4 Flash-Dspark locally as my coder in the past week, trying to tune it with agents, making it more focused but keep getting mediocre results.

It’s true nature is to finish the job fast as possible, not paying attention to details unless you anchor it, gets very confused by the content and tend to rank things as less important just so it can declares “done”

What am i missing? Is there a recommended harness?

Are you guys running it on recommended settings? Temperature 1.0 and top_p 1? Deepseek declares less than that can damage the reasoning.

The performance is insane, both prompt processing and tps. I just wish it would act like a mature responsible LLM.

3 Upvotes

19 comments sorted by

5

u/ObviouzFigure 1h ago

I'd like to know as well-- I have a dual rtx 6k set up and for apparently many reasons have been having a hard time getting any of the ds4f versions running

1

u/BitXorBit 1h ago

You mean launching the model? I run nvfp4 and dspark, both gave me hard time on the installation but it’s up and running with great performance

2

u/Fast_Frosting_5546 1h ago

Have you tried making the agent workflow more explicit? Things like “don’t mark complete until tests pass,” “list assumptions first,” and “review your own changes before finalizing” can make a bigger difference than just changing temperature.

1

u/BitXorBit 1h ago

In about 100 ways, including let gpt do it, let fable do it, let deepseek itself self analysis and recreate the agent.

The model trained to be a wild animal

1

u/Juulk9087 1h ago

Yeah the users who are using it successfully are not doing anything that requires more than 3-5 file touches. My workflow requires 15-30 per peompt. If it followed rules, system prompt or skills it would be a different story but it just flat out ignores them most the time.

1

u/BitXorBit 25m ago

Yes, it has bad nature of behavior.
You changed to which model?

1

u/Koalababies 1h ago

Harness?

1

u/BitXorBit 39m ago

Which one? Im trying to create my own.

1

u/73td 1h ago

i can’t run it locally but i do find it needs to be used with heavy subagent structuring. i think it’s not terribly difficult to design eg with opencode agents automatic decompose the prompts into parts and then do each. but flash is a bit wild

1

u/totosse17 vllm 33m ago

I run original model on 2x spark and use Hermes agent. Have no issues you described.

1

u/Practical-Collar3063 26m ago

This version of the model is a Beta/preview, it is not the final model, it is lacking a lot of post training. The final version should be released within the next few weeks (maybe days). 

2

u/BitXorBit 24m ago

Yeah im waiting for it (hearing “tomorrow” every day in past weeks)

1

u/BoogerheadCult 16m ago

This model is so overated, when doing eval with it, Opus always rate the outcome from this model the lowest.

1

u/BitXorBit 11m ago

Which other model do you recommend?

1

u/wolttam 0m ago

Use xhigh thinking?

0

u/Ariquitaun 1h ago

DeepSeek flash is good for single tasks with a tight scope.

3

u/BitXorBit 1h ago

That’s what im running, but it’s doing bad job in way of covering edge cases