Skip to main content
Search

# Latent Space Advice Retrieval

1 related articles

Subscribe to updates
  1. arXiv

    External advice no longer used once: Encoder BPA retrieves old advice through latent state encoding, speeding early training

    In interactive reinforcement learning, external advice is often used once and discarded; Broad-Persistent Advising reuses it across similar states via K-means clustering, but high-dimensional robot environments allow few clusters, so behaviorally different states can be merged. Encoder BPA instead trains an encoder to map recent state sequences into latent representations and retrieves stored advice by cosine similarity, top-k aggregation and a consistency condition. On Cart-Pole, Inverted Pendulum, MuJoCo Ant and a partially observable Ant, it outperforms pure RL, non-persistent, persistent advising and original BPA early in training, while in continuous-action settings later episodes can decline when inappropriate advice is reused.

You’re all caught up