Open in app

Sign In

Write

Sign In

Sik-Ho Tsang
Sik-Ho Tsang

7.3K Followers

Home

About

Pinned

Summary: My Paper Reading Lists, Tutorials & Sharings

From Image Classification, Object Detection, Natural Language Processing (NLP), Self-Supervised Learning, Semi-Supervised Learning, Vision-Language, Generative Adversarial Network (GAN) to … — In this story, as the list is too long to be posted in each story, a list of my paper readings, tutorials and also sharings are posted here for convenience and will be updated from time to time. Actually, I wrote what I’ve learnt only. Reading a paper can consume…

Deep Learning

8 min read

Summary: My Paper Reading Lists, Tutorials & Sharings
Summary: My Paper Reading Lists, Tutorials & Sharings
Deep Learning

8 min read


1 day ago

Review — Long-Short Transformer: Efficient Transformers for Language and Vision

Transformer-LS, Long-Range & Short-Range Attentions for Language Modelling & Image Classification — Long-Short Transformer: Efficient Transformers for Language and Vision, Transformer-LS, by University of Maryland, NVIDIA, Arizona State University, California Institute of Technology, 2021 NeurIPS, Over 40 Citations (Sik-Ho Tsang @ Medium) NLP, LM, Image Classification, Transformer, Vision Transformer, ViT

Deep Learning

6 min read

Review — Long-Short Transformer: Efficient Transformers for Language and Vision
Review — Long-Short Transformer: Efficient Transformers for Language and Vision
Deep Learning

6 min read


2 days ago

Review — SD-UNet: Stripping down U-Net for Segmentation of Biomedical Images on Platforms with Low Computational Budgets

SD-UNet, Modified U-Net Using WS & GN — SD-UNet: Stripping down U-Net for Segmentation of Biomedical Images on Platforms with Low Computational Budgets, SD-UNet, by Beijing University of Technology, and Guilin University of Electronic Technology, 2020 MDPI J. Diagnostics, Over 60 Citations (Sik-Ho Tsang @ Medium) Medical Imaging, Medical Image Analysis, Image Segmentation, U-Net An extremely fast, small…

Deep Learning

4 min read

Review — SD-UNet: Stripping down U-Net for Segmentation of Biomedical Images on Platforms with Low…
Review — SD-UNet: Stripping down U-Net for Segmentation of Biomedical Images on Platforms with Low…
Deep Learning

4 min read


3 days ago

Review — PersonLab: Person Pose Estimation and Instance Segmentation with a Bottom-Up, Part-Based, Geometric Embedding Model

PersonLab, for Human Pose Estimation & Person Instance Segmentation — PersonLab: Person Pose Estimation and Instance Segmentation with a Bottom-Up, Part-Based, Geometric Embedding Model, PersonLab, by Google Research, 2018 ECCV, Over 500 Citations (Sik-Ho Tsang @ Medium) Human Pose Estimation, Keypoint Detection, Instance Segmentation First, PersonLab learns to detect individual keypoints and group keypoints into person pose instances.

Deep Learning

7 min read

Review — PersonLab: Person Pose Estimation and Instance Segmentation with a Bottom-Up…
Review — PersonLab: Person Pose Estimation and Instance Segmentation with a Bottom-Up…
Deep Learning

7 min read


3 days ago

Review — DeLighT: Deep and Light-weight Transformer

DeLighT, Parameter Reduction for Transformers — DeLighT: Deep and Light-weight Transformer, DeLighT, by University of Washington, Facebook AI Research, and Allen Institute for AI, 2021 ICLR, Over 60 Citations (Sik-Ho Tsang @ Medium) NLP, LM, NMT, Transformer Within each Transformer block, a deep and lightweight transformation is used using DeLighT block. Across blocks, block-wise scaling is…

Deep Learning

5 min read

Review — DeLighT: Deep and Light-weight Transformer
Review — DeLighT: Deep and Light-weight Transformer
Deep Learning

5 min read


4 days ago

Review — ACMix: On the Integration of Self-Attention and Convolution

ACMix, a MIXed model that enjoys the benefit of both self-Attention and Convolution (ACmix), while — On the Integration of Self-Attention and Convolution, ACMix, by Tsinghua University, Huawei Technologies Ltd., and Beijing Academy of Artificial Intelligence, 2022 CVPR, Over 40 Citations (Sik-Ho Tsang @ Medium) Image Classification, Convolution, Self-Attention ACmix, A mixed model that enjoys the benefit of both self-Attention and Convolution, is proposed.

Deep Learning

6 min read

Review — ACMix: On the Integration of Self-Attention and Convolution
Review — ACMix: On the Integration of Self-Attention and Convolution
Deep Learning

6 min read


5 days ago

Review — DALS: Deep Active Lesion Segmentation

DALS, Using Fully Convolutional Network (FCN) and Active Contour Model (ACM) — Deep Active Lesion Segmentation, DALS, by University of California, and Stanford University, 2019 MLMI, Over 40 Citations (Sik-Ho Tsang @ Medium) Medical Imaging, Medical Image Analysis, Image Segmentation Deep Active Lesion Segmentation (DALS), a fully automated segmentation framework is introduced. DALS leverages the powerful nonlinear feature extraction abilities of fully…

Deep Learning

5 min read

Review — DALS: Deep Active Lesion Segmentation
Review — DALS: Deep Active Lesion Segmentation
Deep Learning

5 min read


6 days ago

Brief Review — Sharpness-Aware Minimization for Efficiently Improving Generalization

SAM, Simultaneously Minimizing Training Loss and Sharpness Loss, Using Loss Landscape — Sharpness-Aware Minimization for Efficiently Improving Generalization, Sharpness-Aware Minimization (SAM), by Google Research, and Blueshift, Alphabet, 2021 ICLR, Over 400 Citations (Sik-Ho Tsang @ Medium) Image Classification A novel, effective procedure for instead simultaneously minimizing training loss value and loss for sharpness.

Deep Learning

5 min read

Brief Review — Sharpness-Aware Minimization for Efficiently Improving Generalization
Brief Review — Sharpness-Aware Minimization for Efficiently Improving Generalization
Deep Learning

5 min read


Jan 31

Brief Review — RA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT Scans

RA-UNet, first Work To Use Attention Residual Mechanism for Tumor Segmentation from 3D Medical Volumetric Images. — RA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT Scans, RA-UNet, by Tianjin University, CSIRO Data61, Tianjin University of Traditional Chinese Medicine, and La Trobe…

Deep Learning

6 min read

Brief Review — RA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT…
Brief Review — RA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT…
Deep Learning

6 min read


Jan 30

Review — VAN: Visual Attention Network

VAN, Large Kernel Convolution by Decomposition — Visual Attention Network, VAN, by Tsinghua University, Nankai University University, and Fitten Tech, 2022 arXiv v5, Over 80 Citations (Sik-Ho Tsang @ Medium) Image Classification Applying self-attention in computer vision is challenging: (1) Treating images as 1D sequences neglects their 2D structures…

Deep Learning

4 min read

Review — VAN: Visual Attention Network
Review — VAN: Visual Attention Network
Deep Learning

4 min read

Sik-Ho Tsang

Sik-Ho Tsang

7.3K Followers

PhD, Researcher. I share what I learn. :) Reads: https://bit.ly/33TDhxG, LinkedIn: https://www.linkedin.com/in/sh-tsang/, Twitter: https://twitter.com/SHTsang3

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech