Toshiba TC358743 Linux driver for Jetson: Difference between revisions

From RidgeRun Developer Wiki
Line 23: Line 23:
In order to purchase the source code please send an email to '''inquiries@ridgerun.com''' or You can submit your Inquiry at our  [http://www.ridgerun.com/contact Contact Us Page]
In order to purchase the source code please send an email to '''inquiries@ridgerun.com''' or You can submit your Inquiry at our  [http://www.ridgerun.com/contact Contact Us Page]


= Enable driver =
=Build Driver=
The driver was developed for kernel 3.10.67 using NVIDIA kernel source l4t-r23.2.


'''1.''' Follow the instructions in [[Compiling_Tegra_X1_source_code#Downloading_the_code|Compiling_Tegra_X1_source_code (Downloading the code)]] to get the kernel source code.
==Build kernel using Jetpack 2.3.1==


'''2.''' Once you have the source code, apply the following two patches if you haven't yet, for fixing kernel errors during compilation.
'''1.''' Install jetpack 2.3.1


kernel_r7_asm.patch
<pre>
./JetPack-L4T-2.3.1-linux-x64.run
cd 64_TX1/Linux_for_Tegra_64_tx1/
</pre>
 
'''2.''' Download kernel sources
<pre>
./source_sync.sh -k tegra-l4t-r24.2.1
</pre>
 
'''3.''' Create copy of the kernel source to keep a reference of the code.
<pre>
cp sources sources_tc358743 -a
cd sources_tc358743/
</pre>
 
'''4.''' Download tc358743-r24.2.1-j106.tar.gz file and apply the patches.
<pre>
tar -xzvf tc358743-r24.2.1-j106.tar.gz
quilt push -a
</pre>
 
'''5.''' Compile the kernel. Specify the path to the toolchain and architecture: (see http://developer.ridgerun.com/wiki/index.php?title=Compiling_Tegra_X1_source_code#Toolchain)
<pre>
export CROSS_COMPILE=/opt/linaro/gcc-linaro-5.3-2016.02-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-
export CROSS32CC=/opt/linaro/gcc-linaro-5.3-2016.02-x86_64_arm-linux-gnueabihf/bin/arm-linux-gnueabihf-gcc
export ARCH=arm64
</pre>
 
'''6.''' Define and create destination directories.
<pre>
export TEGRA_KERNEL_OUT=/home/$USER/JetPack-L4T-2.3.1/64_TX1/Linux_for_Tegra_64_tx1/sources_tc358743/images
export TEGRA_MODULES_OUT=/home/$USER/JetPack-L4T-2.3.1/64_TX1/Linux_for_Tegra_64_tx1/sources_tc358743/modules
mkdir -p $TEGRA_KERNEL_OUT
mkdir -p $TEGRA_MODULES_OUT
</pre>


logical_comparison.patch
'''7.''' Configure your kernel
<pre>
make -C kernel_source O=$TEGRA_KERNEL_OUT tegra21_defconfig
make -C kernel_source menuconfig
</pre>


'''3.''' Apply the driver patches:
'''8.''' Configure your kernel
<pre>
make -C kernel_source O=$TEGRA_KERNEL_OUT tegra21_defconfig
</pre>


add-tc358743-driver.patch
'''8.''' Enable driver


add-tc358743-dtb.patch
<pre>
make -C kernel_source O=$TEGRA_KERNEL_OUT menuconfig
</pre>


fix-continuos-clock-in-v4l2-driver.patch
Select the driver. The menu option is located:


'''4.''' Follow the instructions in [[Compiling_Tegra_X1_source_code#Build_Kernel|Compiling_Tegra_X1_source_code (Build Kernel)]] for building the kernel, and then flash the image.
<pre>
-> Device Drivers
  -> Multimedia support (MEDIA_SUPPORT [=y])
    -> Encoders, decoders, sensors and other helper chips
      <*> Toshiba TC358743 decoder
</pre>


Make sure to enable tc358743 driver support and soc_camera support, and disable platform camera support.
'''6.''' Compile kernel, device tree and modules
<pre>
<pre>
make menuconfig
make -C kernel_source O=$TEGRA_KERNEL_OUT zImage
make -C kernel_source O=$TEGRA_KERNEL_OUT dtbs
make -C kernel_source O=$TEGRA_KERNEL_OUT modules
make -C kernel_source O=$TEGRA_KERNEL_OUT modules_install INSTALL_MOD_PATH=$TEGRA_MODULES_OUT
</pre>
</pre>


== Test your Kernel image using Jetpack 2.3.1 root file system==
'''1.''' Go to Linux_for_Tegra_64_tx1 directory. Let's call $JETPACKDIR the path where you installed your development directory or Jetpack.
<pre>
<pre>
-> Device Drivers                                                                                                                       
cd $JETPACKDIR/64_TX1/Linux_for_Tegra_64_tx1/
  -> Multimedia support                                                                                         
    -> Sensors used on soc_camera driver
      -> <M>tc358743 support
</pre>
</pre>
'''2.''' Put the board into force USB Recovery Mode:
<pre>
1. Power down the device. If connected, remove the AC adapter from the device. The device must be
powered OFF, and not in a suspend or sleep state.
2. Connect the Micro-B plug on the USB cable to the Recovery (USB Micro-B) Port on the device and
the other end to an available USB port on the host PC.
3. Connect the power adapter to the device.
4. Press POWER button
5. Press and hold the RECOVERY FORCE (REC) button.
6. While pressing the RECOVERY FORCE button, press and release the RESET button.
7. Wait 2 seconds and release the RECOVERY FORCE button
</pre>
'''3.''' Use ./flash.sh in order to configure TX1 board, Also this script configures jetpack rootfs to be used as SD filesystem.
Execute the script as follows:
<pre>
sudo ./flash.sh jetson-tx1 mmcblk1p1
</pre>
'''4.''' Create ext4 partition called "rootfs".
<pre>
sudo mkfs.ext4 /dev/mmcblk0p1 -L "rootfs"
</pre>
'''5.''' Copy rootfs from jetpack 2.3.1
<pre>
sudo cp -a $JETPACKDIR/64_TX1/Linux_for_Tegra_tx1/rootfs/* /media/$USER/rootfs/
</pre>
'''6.''' Copy kernel image, device tree, and modules.
<pre>
cd $TEGRA_KERNEL_OUT
sudo cp -a arch/arm64/boot/Image /media/$USER/rootfs/boot/Image
sudo cp -a arch/arm64/boot/dts/tegra210-jetson-tx1-p2597-2180-a01-devkit.dtb /media/$USER/rootfs/boot/tegra210-jetson-tx1-p2597-2180-a01-devkit.dtb
cd $TEGRA_MODULES_OUT
sudo cp -a lib/* /media/$USER/rootfs/lib/
</pre>
'''7.''' Unmount the device and Put the SD into the TX1 board, and boot the board.
<pre>
umount /media/$USER/rootfs
</pre>
'''8.''' Check kernel version. At this moment you can test the image created in order to see the new kernel is working correctly. You have to see a new kernel version:
<pre>
uname -a
Linux tegra-ubuntu 3.10.96+ #1 SMP PREEMPT Tue May 2 14:08:05 CST 2017 aarch64 aarch64 aarch64 GNU/Linux
</pre>
==J106==
You can see that the driver is proved, execute the line:  dmesg | grep "(Tegra I2C adapter)"
Expected output:
<pre>
ubuntu@tegra-ubuntu:~$ dmesg | grep "(Tegra I2C adapter)"
[    4.554634] tc358743 0-000f: tc358743 found @ 0xf (Tegra I2C adapter)
[    4.665076] tc358743 2-000f: tc358743 found @ 0xf (Tegra I2C adapter)
[    4.727283] tc358743 2-000d: tc358743 found @ 0xd (Tegra I2C adapter)
[    4.843073] tc358743 6-000f: tc358743 found @ 0xf (Tegra I2C adapter)
[    4.907802] tc358743 6-000d: tc358743 found @ 0xd (Tegra I2C adapter)
</pre>
'''Note'''In this case, I have connected 5 devices in J106 ports. The output varies slightly when 6 devices are connected.
I have 5 video devices created:


<pre>
<pre>
-> Device Drivers                                                                                                                       
ls /dev/video*
  -> Multimedia support
/dev/video0  /dev/video2  /dev/video3  /dev/video4  /dev/video5
    ->V4L platform devices
        -> <*> SoC camera support
            -> < > platform camera support
</pre>
</pre>



Revision as of 13:41, 18 September 2017

Template:Eval SDK Download, Demo Image download and Contact Us buttons

TC358743 features

Reference: Toshiba TC358743 bridge chip

The Toshiba TC358743 is an HDMI 1.4 to MIPI CSI-2 1.01 bridge chip capable of handling video data up to 1080P at 60 fps.

* Tested resolutions are 640x480, 720x480, 1280x720, 1920x1080. Tested format is UYVY.
* The TC358743 driver supports 2 and 4 lanes configuration for the given resolutions.

Source code

In order to purchase the source code please send an email to inquiries@ridgerun.com or You can submit your Inquiry at our Contact Us Page

Build Driver

Build kernel using Jetpack 2.3.1

1. Install jetpack 2.3.1

./JetPack-L4T-2.3.1-linux-x64.run
cd 64_TX1/Linux_for_Tegra_64_tx1/

2. Download kernel sources

./source_sync.sh -k tegra-l4t-r24.2.1

3. Create copy of the kernel source to keep a reference of the code.

cp sources sources_tc358743 -a
cd sources_tc358743/

4. Download tc358743-r24.2.1-j106.tar.gz file and apply the patches.

tar -xzvf tc358743-r24.2.1-j106.tar.gz
quilt push -a

5. Compile the kernel. Specify the path to the toolchain and architecture: (see http://developer.ridgerun.com/wiki/index.php?title=Compiling_Tegra_X1_source_code#Toolchain)

export CROSS_COMPILE=/opt/linaro/gcc-linaro-5.3-2016.02-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-
export CROSS32CC=/opt/linaro/gcc-linaro-5.3-2016.02-x86_64_arm-linux-gnueabihf/bin/arm-linux-gnueabihf-gcc
export ARCH=arm64

6. Define and create destination directories.

export TEGRA_KERNEL_OUT=/home/$USER/JetPack-L4T-2.3.1/64_TX1/Linux_for_Tegra_64_tx1/sources_tc358743/images
export TEGRA_MODULES_OUT=/home/$USER/JetPack-L4T-2.3.1/64_TX1/Linux_for_Tegra_64_tx1/sources_tc358743/modules
mkdir -p $TEGRA_KERNEL_OUT
mkdir -p $TEGRA_MODULES_OUT

7. Configure your kernel

make -C kernel_source O=$TEGRA_KERNEL_OUT tegra21_defconfig
make -C kernel_source menuconfig

8. Configure your kernel

make -C kernel_source O=$TEGRA_KERNEL_OUT tegra21_defconfig

8. Enable driver

make -C kernel_source O=$TEGRA_KERNEL_OUT menuconfig

Select the driver. The menu option is located:

-> Device Drivers
  -> Multimedia support (MEDIA_SUPPORT [=y])
    -> Encoders, decoders, sensors and other helper chips
       <*> Toshiba TC358743 decoder

6. Compile kernel, device tree and modules

make -C kernel_source O=$TEGRA_KERNEL_OUT zImage
make -C kernel_source O=$TEGRA_KERNEL_OUT dtbs
make -C kernel_source O=$TEGRA_KERNEL_OUT modules
make -C kernel_source O=$TEGRA_KERNEL_OUT modules_install INSTALL_MOD_PATH=$TEGRA_MODULES_OUT

Test your Kernel image using Jetpack 2.3.1 root file system

1. Go to Linux_for_Tegra_64_tx1 directory. Let's call $JETPACKDIR the path where you installed your development directory or Jetpack.

cd $JETPACKDIR/64_TX1/Linux_for_Tegra_64_tx1/

2. Put the board into force USB Recovery Mode:

1. Power down the device. If connected, remove the AC adapter from the device. The device must be
powered OFF, and not in a suspend or sleep state.
2. Connect the Micro-B plug on the USB cable to the Recovery (USB Micro-B) Port on the device and
the other end to an available USB port on the host PC.
3. Connect the power adapter to the device.
4. Press POWER button
5. Press and hold the RECOVERY FORCE (REC) button.
6. While pressing the RECOVERY FORCE button, press and release the RESET button.
7. Wait 2 seconds and release the RECOVERY FORCE button

3. Use ./flash.sh in order to configure TX1 board, Also this script configures jetpack rootfs to be used as SD filesystem. Execute the script as follows:

sudo ./flash.sh jetson-tx1 mmcblk1p1

4. Create ext4 partition called "rootfs".

 sudo mkfs.ext4 /dev/mmcblk0p1 -L "rootfs"

5. Copy rootfs from jetpack 2.3.1

sudo cp -a $JETPACKDIR/64_TX1/Linux_for_Tegra_tx1/rootfs/* /media/$USER/rootfs/

6. Copy kernel image, device tree, and modules.

cd $TEGRA_KERNEL_OUT
sudo cp -a arch/arm64/boot/Image /media/$USER/rootfs/boot/Image 
sudo cp -a arch/arm64/boot/dts/tegra210-jetson-tx1-p2597-2180-a01-devkit.dtb /media/$USER/rootfs/boot/tegra210-jetson-tx1-p2597-2180-a01-devkit.dtb
cd $TEGRA_MODULES_OUT
sudo cp -a lib/* /media/$USER/rootfs/lib/

7. Unmount the device and Put the SD into the TX1 board, and boot the board.

umount /media/$USER/rootfs 

8. Check kernel version. At this moment you can test the image created in order to see the new kernel is working correctly. You have to see a new kernel version:

uname -a
Linux tegra-ubuntu 3.10.96+ #1 SMP PREEMPT Tue May 2 14:08:05 CST 2017 aarch64 aarch64 aarch64 GNU/Linux

J106

You can see that the driver is proved, execute the line: dmesg | grep "(Tegra I2C adapter)"

Expected output:

ubuntu@tegra-ubuntu:~$ dmesg | grep "(Tegra I2C adapter)"
[    4.554634] tc358743 0-000f: tc358743 found @ 0xf (Tegra I2C adapter)
[    4.665076] tc358743 2-000f: tc358743 found @ 0xf (Tegra I2C adapter)
[    4.727283] tc358743 2-000d: tc358743 found @ 0xd (Tegra I2C adapter)
[    4.843073] tc358743 6-000f: tc358743 found @ 0xf (Tegra I2C adapter)
[    4.907802] tc358743 6-000d: tc358743 found @ 0xd (Tegra I2C adapter)

NoteIn this case, I have connected 5 devices in J106 ports. The output varies slightly when 6 devices are connected.

I have 5 video devices created:

ls /dev/video*
/dev/video0  /dev/video2  /dev/video3  /dev/video4  /dev/video5

Mount the kernel module

sudo rmmod nvhost_vi

sudo modprobe tc358743

sudo modprobe tegra_camera

Examples

Yavta

Yavta (Yet Another V4L2 Test Application) can be used for testing the driver, according to the input video resolution:

./yavta /dev/video0 -c1 -n1 -s640x480 -Ftest1.raw
./yavta /dev/video0 -c1 -n1 -s1280x720 -Ftest2.raw
./yavta /dev/video0 -c1 -n1 -s1920x1080 -Ftest3.raw

Also Raw pixels can be used for visualizing the captured frame.

GStreamer

To capture a video of 100 frames, and according to the input video resolution use:

gst-launch-1.0 v4l2src num-buffers=100 ! 'video/x-raw,width=640,height=480,format=UYVY,framerate=60/1'\
 ! filesink location=test4.raw
gst-launch-1.0 v4l2src num-buffers=100 ! 'video/x-raw,width=1280,height=720,format=UYVY,framerate=60/1'\
 ! filesink location=test5.raw
gst-launch-1.0 v4l2src num-buffers=100 ! 'video/x-raw,width=1920,height=1080,format=UYVY,framerate=60/1'\
 ! filesink location=test6.raw

Output video can be visualized using Vooya


Also, the following pipeline can be used to visualize the input video in the Tegra X1:

  • 640x480@60fps
gst-launch-1.0 v4l2src ! 'video/x-raw,format=UYVY,width=640,height=480,framerate=(fraction)60/1' ! queue ! videoconvert ! nveglglessink
  • 720x480@60fps
gst-launch-1.0 v4l2src ! 'video/x-raw,format=UYVY,width=720,height=480,framerate=(fraction)60/1' ! queue ! videoconvert ! nveglglessink
  • 1280x720@60fps
gst-launch-1.0 v4l2src ! 'video/x-raw,format=UYVY,width=1280,height=720,framerate=(fraction)60/1' ! queue ! videoconvert ! nveglglessink
  • 1280x720@30fps
gst-launch-1.0 v4l2src ! 'video/x-raw,format=UYVY,width=1280,height=720,framerate=(fraction)30/1' ! queue ! videoconvert ! nveglglessink
  • 1920x1080@60fps
gst-launch-1.0 v4l2src ! 'video/x-raw,format=UYVY,width=1920,height=1080,framerate=(fraction)60/1' ! queue ! videoconvert ! nveglglessink
  • 1920x1080@30fps
gst-launch-1.0 v4l2src ! 'video/x-raw,format=UYVY,width=1920,height=1080,framerate=(fraction)30/1' ! queue ! videoconvert ! nveglglessink

Articles related

Toshiba TC358743 Linux driver for iMX6