-
Notifications
You must be signed in to change notification settings - Fork 1.6k
Open
Labels
bugSomething isn't workingSomething isn't working
Description
/!\ PLEASE INCLUDE THE FULL STACKTRACE AND CODE SNIPPET
Short description
Fail to load bridge data and got the following error message.
Trying to use open-x-embodiment dataset and success to load other datasets (droid, fractal20220817_data)
Environment information
- Operating System: Ubuntu 22.04.5 LTS
- Python version: Python 3.11.13
tensorflow-datasets
/tfds-nightly
version: tfds-nightly 4.9.9.dev202507090045tensorflow
/tf-nightly
version: tensorflow 2.19.0- Does the issue still exists with the last
tfds-nightly
package (pip install --upgrade tfds-nightly
) ?
Reproduction instructions
ds_bridge = tfds.load("bridge", data_dir="/workspace/data/tensorflow_datasets", split="train")
for example in ds_bridge.take(1):
print(example.keys())
for k, v in example.items():
print(f"{k}: {type(v)}")
If you share a colab, make sure to update the permissions to share it.
Link to logs
2025-07-16 08:10:35.005820: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.096368: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.282598: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.298123: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.390655: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.406193: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
---------------------------------------------------------------------------
InvalidArgumentError Traceback (most recent call last)
Cell In[44], line 3
1 import tensorflow as tf
2 ds_bridge = tfds.load("bridge", data_dir="[/workspace/data/tensorflow_datasets](http://34.29.152.171:32238/lab/tree/data/open_x_embodiment/data/tensorflow_datasets)", split="train")
----> 3 for example in ds_bridge.take(1):
4 print(example.keys())
5 # 또는 깊이 있는 구조 확인
File [/opt/conda/lib/python3.11/site-packages/tensorflow/python/data/ops/iterator_ops.py:826](http://34.29.152.171:32238/opt/conda/lib/python3.11/site-packages/tensorflow/python/data/ops/iterator_ops.py#line=825), in OwnedIterator.__next__(self)
824 def __next__(self):
825 try:
--> 826 return self._next_internal()
827 except errors.OutOfRangeError:
828 raise StopIteration
File [/opt/conda/lib/python3.11/site-packages/tensorflow/python/data/ops/iterator_ops.py:776](http://34.29.152.171:32238/opt/conda/lib/python3.11/site-packages/tensorflow/python/data/ops/iterator_ops.py#line=775), in OwnedIterator._next_internal(self)
773 # TODO(b[/77291417](http://34.29.152.171:32238/77291417)): This runs in sync mode as iterators use an error status
774 # to communicate that there is no more data to iterate over.
775 with context.execution_mode(context.SYNC):
--> 776 ret = gen_dataset_ops.iterator_get_next(
777 self._iterator_resource,
778 output_types=self._flat_output_types,
779 output_shapes=self._flat_output_shapes)
781 try:
782 # Fast path for the case `self._structure` is not a nested structure.
783 return self._element_spec._from_compatible_tensor_list(ret) # pylint: disable=protected-access
File [/opt/conda/lib/python3.11/site-packages/tensorflow/python/ops/gen_dataset_ops.py:3086](http://34.29.152.171:32238/opt/conda/lib/python3.11/site-packages/tensorflow/python/ops/gen_dataset_ops.py#line=3085), in iterator_get_next(iterator, output_types, output_shapes, name)
3084 return _result
3085 except _core._NotOkStatusException as e:
-> 3086 _ops.raise_from_not_ok_status(e, name)
3087 except _core._FallbackException:
3088 pass
File [/opt/conda/lib/python3.11/site-packages/tensorflow/python/framework/ops.py:6006](http://34.29.152.171:32238/opt/conda/lib/python3.11/site-packages/tensorflow/python/framework/ops.py#line=6005), in raise_from_not_ok_status(e, name)
6004 def raise_from_not_ok_status(e, name) -> NoReturn:
6005 e.message += (" name: " + str(name if name is not None else ""))
-> 6006 raise core._status_to_exception(e) from None
InvalidArgumentError: {{function_node __wrapped__IteratorGetNext_output_types_8_device_[/job](http://34.29.152.171:32238/job):localhost[/replica:0](http://34.29.152.171:32238/replica#line=-1)[/task:0](http://34.29.152.171:32238/task#line=-1)[/device](http://34.29.152.171:32238/device):CPU:0}} Error in user-defined function passed to ParallelMapDatasetV2:1147464 transformation with iterator: Iterator::Root::Prefetch::FiniteTake::Prefetch::ParallelMapV2: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
[[{{node ParseSingleExample[/ParseExample/ParseExampleV2](http://34.29.152.171:32238/ParseExample/ParseExampleV2)}}]] [Op:IteratorGetNext] name:
2025-07-16 08:10:35.492995: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.581938: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.592241: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.681687: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.790991: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.802541: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.896098: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.906361: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.990240: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:36.009033: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:36.009087: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:36.009156: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:36.009175: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working