BananaMind 2 Assistant2User
[Image blocked: banner]
BananaMind 2 Assistant2User is a 139M parameter language model trained to reconstruct a likely user message from an assistant response.
The model starts from BananaMind/BananaMind-2-Pro and is fully fine-tuned on reversed conversations from HuggingFaceTB/smol-smoltalk.
Normal conversation direction:
Training direction:
The model receives the assistant response as context and predicts the user message that likely caused that response.
Example
Input:
Output:
Training
The original Smol-SmolTalk conversations contain messages in the usual structure:
Every adjacent user and assistant pair was converted into an independent reversed training example.
For example:
becomes:
Loss is applied only to the reconstructed user message. The assistant response and reconstruction prefix are masked from the training loss.
Training configuration
Evaluation
The model was evaluated by taking conversations from the Smol-SmolTalk test split, hiding the original user message, giving the model only the assistant response, and comparing the generated reconstruction against the original user message.
The results below are from the first 2500 extracted user-assistant pairs from the test split.
Token Top-1 Accuracy
Token Top-1 Accuracy measures how close the generated token sequence is to the original user message using token-level edit distance.
A score of 100% means the generated user message is token-for-token identical after tokenization.
This metric is strict. Semantically equivalent reconstructions can receive a much lower score when they use different wording.
For example:
These messages express essentially the same request while differing substantially at the token level.
Samples
Factual question
Assistant response:
Reconstructed user message:
Yes or no question
Assistant response:
Reconstructed user message:
Programming question
Assistant response:
Reconstructed user message:
Installation question
Assistant response:
Reconstructed user message:
Time complexity
Assistant response:
Reconstructed user message:
Long-answer reconstruction
Assistant response:
Reconstructed user message:
This example was tested on an assistant response from a real ChatGPT conversation rather than Smol-SmolTalk.
Usage
Example output:
What the model learns
Assistant-to-user reconstruction is inherently underdetermined.
An assistant response such as:
could reasonably come from many prompts:
The model therefore learns to generate a plausible originating user message based on the assistant response and the patterns present in its training data.
Short responses such as:
provide very little information about the original question. Reconstructions from highly ambiguous responses can contain invented context.
Longer and more informative assistant responses generally provide much stronger signals for reconstruction.
Current limitations
The model has approximately 139M parameters, so generation quality varies substantially across inputs.
Observed failure modes include:
- Copying the assistant response instead of reconstructing a user message
- Generating additional context that was not present in the original prompt
- Recovering the correct topic while choosing a different question type
- Producing long synthetic-style instructions
- Poor reconstruction when the assistant response contains very little information
- Repetition on difficult generations
The model performs especially well on assistant messages where the likely originating request is strongly implied by the answer.
Base model
BananaMind/BananaMind-2-Pro
Dataset
HuggingFaceTB/smol-smoltalk