这是indexloc提供的服务,不要输入任何密码
Skip to content

Fail to load bridge data #11087

@jhkim-lgai

Description

@jhkim-lgai

/!\ PLEASE INCLUDE THE FULL STACKTRACE AND CODE SNIPPET

Short description
Fail to load bridge data and got the following error message.
Trying to use open-x-embodiment dataset and success to load other datasets (droid, fractal20220817_data)

Environment information

  • Operating System: Ubuntu 22.04.5 LTS
  • Python version: Python 3.11.13
  • tensorflow-datasets/tfds-nightly version: tfds-nightly 4.9.9.dev202507090045
  • tensorflow/tf-nightly version: tensorflow 2.19.0
  • Does the issue still exists with the last tfds-nightly package (pip install --upgrade tfds-nightly) ?

Reproduction instructions

ds_bridge = tfds.load("bridge", data_dir="/workspace/data/tensorflow_datasets", split="train")
for example in ds_bridge.take(1):
    print(example.keys())
    for k, v in example.items():
        print(f"{k}: {type(v)}")

If you share a colab, make sure to update the permissions to share it.

Link to logs

2025-07-16 08:10:35.005820: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.096368: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.282598: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.298123: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.390655: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.406193: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
---------------------------------------------------------------------------
InvalidArgumentError                      Traceback (most recent call last)
Cell In[44], line 3
      1 import tensorflow as tf
      2 ds_bridge = tfds.load("bridge", data_dir="[/workspace/data/tensorflow_datasets](http://34.29.152.171:32238/lab/tree/data/open_x_embodiment/data/tensorflow_datasets)", split="train")
----> 3 for example in ds_bridge.take(1):
      4     print(example.keys())
      5     # 또는 깊이 있는 구조 확인

File [/opt/conda/lib/python3.11/site-packages/tensorflow/python/data/ops/iterator_ops.py:826](http://34.29.152.171:32238/opt/conda/lib/python3.11/site-packages/tensorflow/python/data/ops/iterator_ops.py#line=825), in OwnedIterator.__next__(self)
    824 def __next__(self):
    825   try:
--> 826     return self._next_internal()
    827   except errors.OutOfRangeError:
    828     raise StopIteration

File [/opt/conda/lib/python3.11/site-packages/tensorflow/python/data/ops/iterator_ops.py:776](http://34.29.152.171:32238/opt/conda/lib/python3.11/site-packages/tensorflow/python/data/ops/iterator_ops.py#line=775), in OwnedIterator._next_internal(self)
    773 # TODO(b[/77291417](http://34.29.152.171:32238/77291417)): This runs in sync mode as iterators use an error status
    774 # to communicate that there is no more data to iterate over.
    775 with context.execution_mode(context.SYNC):
--> 776   ret = gen_dataset_ops.iterator_get_next(
    777       self._iterator_resource,
    778       output_types=self._flat_output_types,
    779       output_shapes=self._flat_output_shapes)
    781   try:
    782     # Fast path for the case `self._structure` is not a nested structure.
    783     return self._element_spec._from_compatible_tensor_list(ret)  # pylint: disable=protected-access

File [/opt/conda/lib/python3.11/site-packages/tensorflow/python/ops/gen_dataset_ops.py:3086](http://34.29.152.171:32238/opt/conda/lib/python3.11/site-packages/tensorflow/python/ops/gen_dataset_ops.py#line=3085), in iterator_get_next(iterator, output_types, output_shapes, name)
   3084   return _result
   3085 except _core._NotOkStatusException as e:
-> 3086   _ops.raise_from_not_ok_status(e, name)
   3087 except _core._FallbackException:
   3088   pass

File [/opt/conda/lib/python3.11/site-packages/tensorflow/python/framework/ops.py:6006](http://34.29.152.171:32238/opt/conda/lib/python3.11/site-packages/tensorflow/python/framework/ops.py#line=6005), in raise_from_not_ok_status(e, name)
   6004 def raise_from_not_ok_status(e, name) -> NoReturn:
   6005   e.message += (" name: " + str(name if name is not None else ""))
-> 6006   raise core._status_to_exception(e) from None

InvalidArgumentError: {{function_node __wrapped__IteratorGetNext_output_types_8_device_[/job](http://34.29.152.171:32238/job):localhost[/replica:0](http://34.29.152.171:32238/replica#line=-1)[/task:0](http://34.29.152.171:32238/task#line=-1)[/device](http://34.29.152.171:32238/device):CPU:0}} Error in user-defined function passed to ParallelMapDatasetV2:1147464 transformation with iterator: Iterator::Root::Prefetch::FiniteTake::Prefetch::ParallelMapV2: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
	 [[{{node ParseSingleExample[/ParseExample/ParseExampleV2](http://34.29.152.171:32238/ParseExample/ParseExampleV2)}}]] [Op:IteratorGetNext] name: 
2025-07-16 08:10:35.492995: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.581938: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.592241: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.681687: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.790991: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.802541: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.896098: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.906361: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:35.990240: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:36.009033: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:36.009087: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:36.009156: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.
2025-07-16 08:10:36.009175: W tensorflow[/core/framework/op_kernel.cc:1857](http://34.29.152.171:32238/core/framework/op_kernel.cc#line=1856)] OP_REQUIRES failed at example_parsing_ops.cc:98 : INVALID_ARGUMENT: Feature: episode_metadata[/episode_id](http://34.29.152.171:32238/episode_id) (data type: int64) is required but could not be found.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions