sim

Documentation

Overview

Package sim provides a multi-stage discrete-event simulation for RL-based pipeline control experiments.

Index

• type Env
  • func NewEnv(cfg EnvConfig) *Env
  • func (e *Env) CheckConservation() bool
  • func (e *Env) Reset(seed uint64) Observation
  • func (e *Env) Step(actions []int) (Observation, float64, bool, StepInfo)
• type EnvConfig
• type Observation
• type StageConfig
• type StageObs
• type StepInfo

Types

type Env

type Env struct {
	// contains filtered or unexported fields
}

Env is the RL environment wrapping a multi-stage DES.

func NewEnv

func NewEnv(cfg EnvConfig) *Env

NewEnv creates an environment. Panics on invalid config.

func (*Env) CheckConservation

func (e *Env) CheckConservation() bool

CheckConservation verifies arrivals = backlog + WIP + completed.

func (*Env) Reset

func (e *Env) Reset(seed uint64) Observation

Reset starts a new episode with the given seed. Returns initial observation.

func (*Env) Step

func (e *Env) Step(actions []int) (Observation, float64, bool, StepInfo)

Step applies actions, runs one interval, returns observation, reward, done, info. actions[i] = MaxWIP for stage i (0 = unbounded). Panics if called after done or before Reset.

type EnvConfig

type EnvConfig struct {
	Stages       []StageConfig
	ArrivalMean  float64 // > 0
	IntervalTime float64 // sim time per Step; > 0
	MaxItems     int     // episode ends after N completions; 0 = use MaxTime
	MaxTime      float64 // episode ends after this sim time; 0 = use MaxItems
	RewardAlpha  float64 // WIP penalty coefficient; default 0.01
}

EnvConfig configures the RL environment.

type Observation

type Observation struct {
	Stages        []StageObs
	SourceBacklog int
	TotalWIP      int
	SimTime       float64
}

Observation is the RL observation (current state only).

type StageConfig

type StageConfig struct {
	Workers     int     // parallel servers; >= 1
	ServiceMean float64 // exponential mean service time; > 0
}

StageConfig configures one stage in the pipeline.

type StageObs

type StageObs struct {
	Queued              int
	InService           int
	BlockedAfterService int
	Workers             int
	MaxWIP              int
}

StageObs is the per-stage observation (current state only).

type StepInfo

type StepInfo struct {
	Completions      int
	IntervalTime     float64
	AvgTotalWIP      float64
	AvgSourceBacklog float64
}

StepInfo contains interval diagnostics (not for policy input).