66,000원
다른 수강생들이 자주 물어보는 질문이 궁금하신가요?
- 미해결프로그래머를 위한 강화학습(저자 직강)
TypeError: in user code: TypeError: Can not convert a NoneType into a Tensor or Operation.
- cartpole_reinforce.ipynb를 pycharm에서 .py로 변경해서 예제코드를 돌리고 있는 중에 위와 같은 에러가 발생했습니다. - tensorflow_gpu는 2.3.0이고, python version은 3.7.10 입니다. - 아, keras-applications는 10.0.8, keras-preprocessing은 1.1.2 입니다. 에러가 keras version 하고 관계있나요? 에러는 다음과 같습니다. Traceback (most recent call last): File "C:/WorkSpace/RL/kimnam/rl-main/rl-main/codes/cartpole_reinforce.py", line 163, in <module> agent.train() File "C:/WorkSpace/RL/kimnam/rl-main/rl-main/codes/cartpole_reinforce.py", line 80, in train self.train_mini_batch() File "C:/WorkSpace/RL/kimnam/rl-main/rl-main/codes/cartpole_reinforce.py", line 148, in train_mini_batch self.model.fit(x=[states_t, action_matrixs_t, discount_rewards_t], y=[action_probs_t], epochs=self.epochs_cnt, verbose=0) File "C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\keras\engine\training.py", line 108, in _method_wrapper return method(self, *args, **kwargs) File "C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\keras\engine\training.py", line 1098, in fit tmp_logs = train_function(iterator) File "C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\eager\def_function.py", line 780, in __call__ result = self._call(*args, **kwds) File "C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\eager\def_function.py", line 823, in _call self._initialize(args, kwds, add_initializers_to=initializers) File "C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\eager\def_function.py", line 697, in _initialize *args, **kwds)) File "C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\eager\function.py", line 2855, in _get_concrete_function_internal_garbage_collected graph_function, _, _ = self._maybe_define_function(args, kwargs) File "C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\eager\function.py", line 3213, in _maybe_define_function graph_function = self._create_graph_function(args, kwargs) File "C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\eager\function.py", line 3075, in _create_graph_function capture_by_value=self._capture_by_value), File "C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\framework\func_graph.py", line 986, in func_graph_from_py_func func_outputs = python_func(*func_args, **func_kwargs) File "C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\eager\def_function.py", line 600, in wrapped_fn return weak_wrapped_fn().__wrapped__(*args, **kwds) File "C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\framework\func_graph.py", line 973, in wrapper raise e.ag_error_metadata.to_exception(e) TypeError: in user code: C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\keras\engine\training.py:806 train_function * return step_function(self, iterator) C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\keras\engine\training.py:796 step_function ** outputs = model.distribute_strategy.run(run_step, args=(data,)) C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\distribute\distribute_lib.py:1211 run return self._extended.call_for_each_replica(fn, args=args, kwargs=kwargs) C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\distribute\distribute_lib.py:2585 call_for_each_replica return self._call_for_each_replica(fn, args, kwargs) C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\distribute\distribute_lib.py:2945 _call_for_each_replica return fn(*args, **kwargs) C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\keras\engine\training.py:791 run_step ** with ops.control_dependencies(_minimum_control_deps(outputs)): C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\framework\ops.py:5359 control_dependencies return get_default_graph().control_dependencies(control_inputs) C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\framework\func_graph.py:360 control_dependencies return super(FuncGraph, self).control_dependencies(filtered_control_inputs) C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\framework\ops.py:4749 control_dependencies c = self.as_graph_element(c) C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\framework\ops.py:3670 as_graph_element return self._as_graph_element_locked(obj, allow_tensor, allow_operation) C:\ProgramData\Anaconda3\envs\leesh\lib\site-packages\tensorflow\python\framework\ops.py:3759 _as_graph_element_locked (type(obj).__name__, types_str)) TypeError: Can not convert a NoneType into a Tensor or Operation. 뭐가 잘 못 되었을 까요?
- 미해결프로그래머를 위한 강화학습(저자 직강)
cartpole_dqn 중 def train_mini_batch(self,Q):에서 Q[0,0,action]의 0,0의 의미는?
Q함수 4개의 states가 0행 0열에 있다는 의미입니까?