How DeepSeek Handles Text: Results of a Hands-On Test

Researchers tested local LLMs in "Everlasting Summer": they linked a Ren’Py game to Ollama through a TCP bridge and made the models pick dialogue lines and routes. The setup worked technically, but the results were weak: DeepSeek and Gemma got stuck in a maze, Qwen spent a long time deliberating over individual scenes, and even the best runs still ended in bad endings. The experiment shows that local models can already be wired into a game engine, but they still struggle with consistent decision-making.

AI-processed from Habr AI; edited by Hamidun News
How DeepSeek Handles Text: Results of a Hands-On Test
Source: Habr AI. Collage: Hamidun News.
Listen to article

A post on the Selectel blog on Habr describes an experiment in which the local large language models DeepSeek and Qwen were connected to the visual novel "Everlasting Summer" and made story decisions in place of the player.

Can the

DeepSeek neural network complete a text-based novel on its own? According to Selectel's test, even powerful local models such as DeepSeek and Qwen often get confused in their answers, slow down on long context and steer the story toward bad endings. In "Everlasting Summer", which has 13 endings, the models failed to pick the optimal story path.

How does DeepSeek work with long context?

The test showed that even strong models such as DeepSeek often get confused in their answers when they have to process long context, and this leads to bad endings in tasks that require sequential decision-making.

Story

Key Questions Answered

Can the DeepSeek neural network complete a text-based novel on its own?

According to Selectel's test, even powerful local models such as DeepSeek and Qwen often get confused in their answers, slow down on long context and steer the story toward bad endings. In "Everlasting Summer", which has 13 endings, the models failed to pick the optimal story path.

How does DeepSeek work with long context?

The test showed that even strong models such as DeepSeek often get confused in their answers when they have to process long context, and this leads to bad endings in tasks that require sequential decision-making.

ZK
Zhemal Khamidun — CPO at Alpina Digital, product manager of AlpinaGPT. Building AI products since 2019. Hamidun News is a pet project that grew into a production aggregator with 6,000+ readers.
✦ Unified AI Workspace · Nomad

Test Frontier LLMs & Autonomous Agents in One Workspace

Run Claude Opus 5.5, GPT-6, Gemini 3.1, and DeepSeek side-by-side in Nomad AI (nomadnet.ai) — unified model routing, deep research, and multimodal workflows under one subscription.

Try Nomad AI →Launch Nomad Agent
What do you think?
Loading comments…