ใใญใฐใฉใใผใฎใใใฎๅผทๅๅญฆ็ฟ(่่ ็ด่ฌ)
ใใธใในใคใใใผใทใงใณใฎๆ ธๅฟๆ่กใๅผทๅๅญฆ็ฟใซ้ขใใๆใ็ฐกๅใง่ฉณ็ดฐใช่ฌ็พฉ!!! 1ๆฅ2ๆ้(2ใคใฎ่ฌ็พฉ)ใ17ๆฅไปฅๅ ใซๅผทๅๅญฆ็ฟใใใชใใฎๆใฎไธญใซๅใใพใใไปใใฎ็ฌ้ใใใๅผทๅๅญฆ็ฟใฏ็่งฃใใใใๅ้กใงใฏใชใใใใชใใฎใใใฎ็ด ๆดใใใใใผใซใซใชใใพใใ
ๅ่ฌ็ 471ๅ
้ฃๆๅบฆ ๅ็ด
ๅ่ฌๆ้ ็กๅถ้

ใ็ฅใใ
2 ไปถ
โ ่ฌ็พฉใฎใทใงใผใใซใใ
ใใใใฌใณใใชใผใง็ดๆ็ใช่ชฌๆใ่ฟฝๅ ใใพใใใ
ๆๆฐใฎใฏใผใญใณใฐใใผใซ๏ผ Stable Baselines3 ๏ผใจใใฏใใใฏ๏ผ Optuna ๏ผใ่ฟฝๅ ใใพใใใ
่ฑๅฏใชๅฎๅไพใใญใธใงใฏใ๏ผ่ณ็ฃ้ ๅๆฆ็ฅใๆฏๅบๅพช็ฐๅคๅ๏ผใๅฎๆฝใใพใใใ
ใใใใจใใใใใพใใ
2022ๅนด12ๆ10ๆฅใจใฉใผใซ้ขใใใ็ฅใใใงใใ
็งใ่ฌ็พฉใใใๅพใ้ข้ฃใใใฑใผใธใซๅคใใฎๅคๆดใใใใพใใใ
ๆฌกใฎ3็จฎ้กใฎใจใฉใผใ็บ็ใใๅฏ่ฝๆงใใใใพใใ
1็ชใจใฉใผใฏprotocใใใฑใผใธใๅคๆดใใใๅๅ ใง็บ็ใใฆใใพใใ
protobufใใใฑใผใธใๅ้คใใใใผใธใงใณ3.8ใใคใณในใใผใซใใใจๅ้กใ่งฃๆฑบใงใใพใใ
ใจใฉใผ2ใฏใgymใใใฑใผใธใๆไพใใใชใปใใ้ขๆฐใฎๅ้กใงใใๆปใๅคใ่พๆธใจใใฆไธใใใใใๆๅใฎๅคใ้ธๆใใstate [0]ใณใผใใ่ฟฝๅ ใใใจๅ้กใ่งฃๆฑบใใพใใ
3็ช็ฎใฎใจใฉใผใฏใgymใใใฑใผใธใๆไพใใstep้ขๆฐใฎๆปใๅคใ1ใค่ฟฝๅ ใใใใใใซ็บ็ใใๅ้กใงใใๅไฟก้จใซnone2ๅคๆฐใ1ใค่ฟฝๅ ใใใใจใง่งฃๆฑบใงใใพใใ
1. ใตใณใใซใใญใฐใฉใ ใๅฎ่กใใใจใๆฌกใฎใใใชใจใฉใผใ็บ็ใใพใใ
TypeError: Descriptors cannot not be created directly.
If this call came from a _ pb2.py file, your generated code is out of date and must be regenerated with protoc >= 3.19.0.
If you cannot immediately regenerate your protos, some other possible workarounds are:
1. Downgrade the protobuf package to 3.20.x or lower.
2. Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION=python (but this will use pure-Python parsing and will be much slower).
1. ่งฃๆฑบๆนๆณ
pip uninstall protobuf
pip install protobuf==3.8
2. ่พๆธๅฆ็ใฎ่งฃๆฑบๆนๆณ
state = env.reset()
state = state[0] #ใณใผใ่ฟฝๅ
3. returnๅค่ฟฝๅ ้จๅใฎ่งฃๆฑบๆนๆณ
state_next, reward, done, none, none2 = self.env.step(action)

