ScalingStep¶
Chainable step that scales the gradients by a fixed factor and/or a factor that varies on a schedule.
If both are given, the product of the two is applied. This node can be used to apply things like a fixed learning rate, a learning rate schedule, and/or the sign flip at the end of the chain to turn the processed gradient into an additive update. Version 0.2.0
Ports/Properties¶
gradients¶
Gradients to be transformed.
- verbose name: Gradients
- default value: None
- port type: DataPort
- value type: object (can be None)
- data direction: INOUT
weights¶
Optional current weights.
- verbose name: Weights
- default value: None
- port type: DataPort
- value type: object (can be None)
- data direction: IN
state¶
Explicit state of the node.
- verbose name: State
- default value: None
- port type: DataPort
- value type: object (can be None)
- data direction: INOUT
factor_schedule¶
Optional schedule for the factor.
- verbose name: Factor Schedule
- default value: None
- port type: DataPort
- value type: BaseNode (can be None)
- data direction: IN
factor¶
Scaling factor to apply to the gradients.
- verbose name: Factor
- default value: 1.0
- port type: FloatPort
- value type: float (can be None)
set_breakpoint¶
Set a breakpoint on this node. If this is enabled, your debugger (if one is attached) will trigger a breakpoint.
- verbose name: Set Breakpoint (Debug Only)
- default value: False
- port type: BoolPort
- value type: bool (can be None)
metadata¶
User-definable meta-data associated with the node. Usually reserved for technical purposes.
- verbose name: Metadata
- default value: {}
- port type: DictPort
- value type: dict (can be None)