ALiSNet: Accurate and Lightweight Human Segmentation Network for Fashion E-Commerce
Accurately estimating human body shape from photos can enable innovative applications in fashion, from mass customization, to size and fit recommendations and virtual try-on. Body silhouettes calculated from user pictures are effective representations of the body shape for downstream tasks. Smartphones provide a convenient way for users to capture images of their body, and on-device image processing allows predicting body segmentation while protecting users privacy. Existing off-the-shelf methods for human segmentation are closed source and cannot be specialized for our application of body shape and measurement estimation. Therefore, we create a new segmentation model by simplifying Semantic FPN with PointRend, an existing accurate model. We finetune this model on a high-quality dataset of humans in a restricted set of poses relevant for our application. We obtain our final model, ALiSNet, with a size of 4MB and 97.6$\pm$1.0$\%$ mIoU, compared to Apple Person Segmentation, which has an accuracy of 94.4$\pm$5.7$\%$ mIoU on our dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
SegmentationVirtual Try-onMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Fusing Hierarchical Convolutional Features for Human Body Segmentation and Clothing Fashion Classification
The clothing fashion reflects the common aesthetics that people share with each other in dressing. To recognize the fashion time of a clothing is meaningful for both an individual and the industry. In this paper, under t…
ClassificationGeneral ClassificationSegmentationFashionPose: Text to Pose to Relight Image Generation for Personalized Fashion Visualization
Realistic and controllable garment visualization is critical for fashion e-commerce, where users expect personalized previews under diverse poses and lighting conditions. Existing methods often rely on predefined poses, …
Image GenerationFashion-Guided Adversarial Attack on Person Segmentation
This paper presents the first adversarial example based method for attacking human instance segmentation networks, namely person segmentation networks in short, which are harder to fool than classification networks. We p…
Adversarial AttackHuman Instance SegmentationInstance SegmentationSegmentation+1Fashionformer: A simple, Effective and Unified Baseline for Human Fashion Segmentation and Recognition
Human fashion understanding is one crucial computer vision task since it has comprehensive information for real-world applications. This focus on joint human fashion segmentation and attribute recognition. Contrary to th…
AttributeFashion UnderstandingSegmentationPatch-based Output Space Adversarial Learning for Joint Optic Disc and Cup Segmentation
Glaucoma is a leading cause of irreversible blindness. Accurate segmentation of the optic disc (OD) and cup (OC) from fundus images is beneficial to glaucoma screening and diagnosis. Recently, convolutional neural networ…
Domain AdaptationSegmentationUnsupervised Domain Adaptation