亚洲男人的天堂2018av,欧美草比,久久久久久免费视频精选,国色天香在线看免费,久久久久亚洲av成人片仓井空

Anomaly detection is the problem of recognizing abnormal inputs based on the seen examples of normal data. Despite recent advances of deep learning in recognizing image anomalies, these methods still prove incapable of handling complex medical images, such as barely visible abnormalities in chest X-rays and metastases in lymph nodes. To address this problem, we introduce a new powerful method of image anomaly detection. It relies on the classical autoencoder approach with a re-designed training pipeline to handle high-resolution, complex images and a robust way of computing an image abnormality score. We revisit the very problem statement of fully unsupervised anomaly detection, where no abnormal examples at all are provided during the model setup. We propose to relax this unrealistic assumption by using a very small number of anomalies of confined variability merely to initiate the search of hyperparameters of the model. We evaluate our solution on natural image datasets with a known benchmark, as well as on two medical datasets containing radiology and digital pathology images. The proposed approach suggests a new strong baseline for image anomaly detection and outperforms state-of-the-art approaches in complex medical image analysis tasks.

相關內容

在數(shu)(shu)據(ju)挖掘中,異(yi)(yi)常(chang)(chang)(chang)檢(jian)(jian)測(ce)(ce)(ce)(英語:anomaly detection)對(dui)不(bu)符合預(yu)期模(mo)式(shi)或(huo)數(shu)(shu)據(ju)集(ji)(ji)中其(qi)他項(xiang)(xiang)目(mu)的(de)(de)(de)(de)(de)項(xiang)(xiang)目(mu)、事件或(huo)觀測(ce)(ce)(ce)值的(de)(de)(de)(de)(de)識別。通常(chang)(chang)(chang)異(yi)(yi)常(chang)(chang)(chang)項(xiang)(xiang)目(mu)會轉變成銀行(xing)欺詐、結(jie)構缺陷、醫療問(wen)題、文(wen)本(ben)錯誤(wu)等類型的(de)(de)(de)(de)(de)問(wen)題。異(yi)(yi)常(chang)(chang)(chang)也被稱為離群值、新奇、噪聲(sheng)、偏(pian)差和例(li)外(wai)。 特別是在檢(jian)(jian)測(ce)(ce)(ce)濫(lan)用與網絡入侵時,有趣性(xing)(xing)(xing)對(dui)象往往不(bu)是罕見(jian)(jian)對(dui)象,但卻(que)是超出(chu)(chu)(chu)預(yu)料的(de)(de)(de)(de)(de)突發活(huo)動(dong)。這種模(mo)式(shi)不(bu)遵循通常(chang)(chang)(chang)統計定義中把異(yi)(yi)常(chang)(chang)(chang)點看作是罕見(jian)(jian)對(dui)象,于(yu)是許(xu)多(duo)異(yi)(yi)常(chang)(chang)(chang)檢(jian)(jian)測(ce)(ce)(ce)方(fang)法(fa)(特別是無(wu)監(jian)督的(de)(de)(de)(de)(de)方(fang)法(fa))將對(dui)此類數(shu)(shu)據(ju)失(shi)效,除非(fei)進行(xing)了合適的(de)(de)(de)(de)(de)聚集(ji)(ji)。相(xiang)反,聚類分(fen)析算法(fa)可(ke)能可(ke)以檢(jian)(jian)測(ce)(ce)(ce)出(chu)(chu)(chu)這些模(mo)式(shi)形成的(de)(de)(de)(de)(de)微聚類。 有三大類異(yi)(yi)常(chang)(chang)(chang)檢(jian)(jian)測(ce)(ce)(ce)方(fang)法(fa)。[1] 在假設數(shu)(shu)據(ju)集(ji)(ji)中大多(duo)數(shu)(shu)實(shi)例(li)都是正常(chang)(chang)(chang)的(de)(de)(de)(de)(de)前提下,無(wu)監(jian)督異(yi)(yi)常(chang)(chang)(chang)檢(jian)(jian)測(ce)(ce)(ce)方(fang)法(fa)能通過尋找與其(qi)他數(shu)(shu)據(ju)最不(bu)匹配(pei)的(de)(de)(de)(de)(de)實(shi)例(li)來檢(jian)(jian)測(ce)(ce)(ce)出(chu)(chu)(chu)未標記測(ce)(ce)(ce)試數(shu)(shu)據(ju)的(de)(de)(de)(de)(de)異(yi)(yi)常(chang)(chang)(chang)。監(jian)督式(shi)異(yi)(yi)常(chang)(chang)(chang)檢(jian)(jian)測(ce)(ce)(ce)方(fang)法(fa)需要一(yi)個已經被標記“正常(chang)(chang)(chang)”與“異(yi)(yi)常(chang)(chang)(chang)”的(de)(de)(de)(de)(de)數(shu)(shu)據(ju)集(ji)(ji),并涉及到訓練(lian)分(fen)類器(qi)(與許(xu)多(duo)其(qi)他的(de)(de)(de)(de)(de)統計分(fen)類問(wen)題的(de)(de)(de)(de)(de)關鍵區別是異(yi)(yi)常(chang)(chang)(chang)檢(jian)(jian)測(ce)(ce)(ce)的(de)(de)(de)(de)(de)內在不(bu)均(jun)衡性(xing)(xing)(xing))。半監(jian)督式(shi)異(yi)(yi)常(chang)(chang)(chang)檢(jian)(jian)測(ce)(ce)(ce)方(fang)法(fa)根據(ju)一(yi)個給定的(de)(de)(de)(de)(de)正常(chang)(chang)(chang)訓練(lian)數(shu)(shu)據(ju)集(ji)(ji)創建一(yi)個表示正常(chang)(chang)(chang)行(xing)為的(de)(de)(de)(de)(de)模(mo)型,然后檢(jian)(jian)測(ce)(ce)(ce)由學(xue)習模(mo)型生成的(de)(de)(de)(de)(de)測(ce)(ce)(ce)試實(shi)例(li)的(de)(de)(de)(de)(de)可(ke)能性(xing)(xing)(xing)。

Deep neural networks have shown promising results in disease detection and classification using medical image data. However, they still suffer from the challenges of handling real-world scenarios especially reliably detecting out-of-distribution (OoD) samples. We propose an approach to robustly classify OoD samples in skin and malaria images without the need to access labeled OoD samples during training. Specifically, we use metric learning along with logistic regression to force the deep networks to learn much rich class representative features. To guide the learning process against the OoD examples, we generate ID similar-looking examples by either removing class-specific salient regions in the image or permuting image parts and distancing them away from in-distribution samples. During inference time, the K-reciprocal nearest neighbor is employed to detect out-of-distribution samples. For skin cancer OoD detection, we employ two standard benchmark skin cancer ISIC datasets as ID, and six different datasets with varying difficulty levels were taken as out of distribution. For malaria OoD detection, we use the BBBC041 malaria dataset as ID and five different challenging datasets as out of distribution. We achieved state-of-the-art results, improving 5% and 4% in TNR@TPR95% over the previous state-of-the-art for skin cancer and malaria OoD detection respectively.

Detecting out-of-distribution (OOD) samples in medical imaging plays an important role for downstream medical diagnosis. However, existing OOD detectors are demonstrated on natural images composed of inter-classes and have difficulty generalizing to medical images. The key issue is the granularity of OOD data in the medical domain, where intra-class OOD samples are predominant. We focus on the generalizability of OOD detection for medical images and propose a self-supervised Cascade Variational autoencoder-based Anomaly Detector (CVAD). We use a variational autoencoders' cascade architecture, which combines latent representation at multiple scales, before being fed to a discriminator to distinguish the OOD data from the in-distribution (ID) data. Finally, both the reconstruction error and the OOD probability predicted by the binary discriminator are used to determine the anomalies. We compare the performance with the state-of-the-art deep learning models to demonstrate our model's efficacy on various open-access medical imaging datasets for both intra- and inter-class OOD. Further extensive results on datasets including common natural datasets show our model's effectiveness and generalizability. The code is available at //github.com/XiaoyuanGuo/CVAD.

The considerable significance of Anomaly Detection (AD) problem has recently drawn the attention of many researchers. Consequently, the number of proposed methods in this research field has been increased steadily. AD strongly correlates with the important computer vision and image processing tasks such as image/video anomaly, irregularity and sudden event detection. More recently, Deep Neural Networks (DNNs) offer a high performance set of solutions, but at the expense of a heavy computational cost. However, there is a noticeable gap between the previously proposed methods and an applicable real-word approach. Regarding the raised concerns about AD as an ongoing challenging problem, notably in images and videos, the time has come to argue over the pitfalls and prospects of methods have attempted to deal with visual AD tasks. Hereupon, in this survey we intend to conduct an in-depth investigation into the images/videos deep learning based AD methods. We also discuss current challenges and future research directions thoroughly.

We address the problem of anomaly detection in videos. The goal is to identify unusual behaviours automatically by learning exclusively from normal videos. Most existing approaches are usually data-hungry and have limited generalization abilities. They usually need to be trained on a large number of videos from a target scene to achieve good results in that scene. In this paper, we propose a novel few-shot scene-adaptive anomaly detection problem to address the limitations of previous approaches. Our goal is to learn to detect anomalies in a previously unseen scene with only a few frames. A reliable solution for this new problem will have huge potential in real-world applications since it is expensive to collect a massive amount of data for each target scene. We propose a meta-learning based approach for solving this new problem; extensive experimental results demonstrate the effectiveness of our proposed method.

Applying artificial intelligence techniques in medical imaging is one of the most promising areas in medicine. However, most of the recent success in this area highly relies on large amounts of carefully annotated data, whereas annotating medical images is a costly process. In this paper, we propose a novel method, called FocalMix, which, to the best of our knowledge, is the first to leverage recent advances in semi-supervised learning (SSL) for 3D medical image detection. We conducted extensive experiments on two widely used datasets for lung nodule detection, LUNA16 and NLST. Results show that our proposed SSL methods can achieve a substantial improvement of up to 17.3% over state-of-the-art supervised learning approaches with 400 unlabeled CT scans.

We introduce a simple, yet powerful student-teacher framework for the challenging problem of unsupervised anomaly detection and pixel-precise anomaly segmentation in high-resolution images. To circumvent the need for prior data labeling, student networks are trained to regress the output of a descriptive teacher network that was pretrained on a large dataset of patches from natural images. Anomalies are detected when the student networks fail to generalize outside the manifold of anomaly-free training data, i.e., when the output of the student networks differ from that of the teacher network. Additionally, the intrinsic uncertainty in the student networks can be used as a scoring function that indicates anomalies. We compare our method to a large number of existing deep-learning-based methods for unsupervised anomaly detection. Our experiments demonstrate improvements over state-of-the-art methods on a number of real-world datasets, including the recently introduced MVTec Anomaly Detection dataset that was specifically designed to benchmark anomaly segmentation algorithms.

In recent years, object detection has experienced impressive progress. Despite these improvements, there is still a significant gap in the performance between the detection of small and large objects. We analyze the current state-of-the-art model, Mask-RCNN, on a challenging dataset, MS COCO. We show that the overlap between small ground-truth objects and the predicted anchors is much lower than the expected IoU threshold. We conjecture this is due to two factors; (1) only a few images are containing small objects, and (2) small objects do not appear enough even within each image containing them. We thus propose to oversample those images with small objects and augment each of those images by copy-pasting small objects many times. It allows us to trade off the quality of the detector on large objects with that on small objects. We evaluate different pasting augmentation strategies, and ultimately, we achieve 9.7\% relative improvement on the instance segmentation and 7.1\% on the object detection of small objects, compared to the current state of the art method on MS COCO.

It is important to detect anomalous inputs when deploying machine learning systems. The use of larger and more complex inputs in deep learning magnifies the difficulty of distinguishing between anomalous and in-distribution examples. At the same time, diverse image and text data are available in enormous quantities. We propose leveraging these data to improve deep anomaly detection by training anomaly detectors against an auxiliary dataset of outliers, an approach we call Outlier Exposure (OE). This enables anomaly detectors to generalize and detect unseen anomalies. In extensive experiments on natural language processing and small- and large-scale vision tasks, we find that Outlier Exposure significantly improves detection performance. We also observe that cutting-edge generative models trained on CIFAR-10 may assign higher likelihoods to SVHN images than to CIFAR-10 images; we use OE to mitigate this issue. We also analyze the flexibility and robustness of Outlier Exposure, and identify characteristics of the auxiliary dataset that improve performance.

In machine learning, novelty detection is the task of identifying novel unseen data. During training, only samples from the normal class are available. Test samples are classified as normal or abnormal by assignment of a novelty score. Here we propose novelty detection methods based on training variational autoencoders (VAEs) on normal data. Since abnormal samples are not used during training, we define novelty metrics based on the (partially complementary) assumptions that the VAE is less capable of reconstructing abnormal samples well; that abnormal samples more strongly violate the VAE regularizer; and that abnormal samples differ from normal samples not only in input-feature space, but also in the VAE latent space and VAE output. These approaches, combined with various possibilities of using (e.g. sampling) the probabilistic VAE to obtain scalar novelty scores, yield a large family of methods. We apply these methods to magnetic resonance imaging, namely to the detection of diffusion-space (q-space) abnormalities in diffusion MRI scans of multiple sclerosis patients, i.e. to detect multiple sclerosis lesions without using any lesion labels for training. Many of our methods outperform previously proposed q-space novelty detection methods. We also evaluate the proposed methods on the MNIST handwritten digits dataset and show that many of them are able to outperform the state of the art.

We introduce an algorithmic method for population anomaly detection based on gaussianization through an adversarial autoencoder. This method is applicable to detection of `soft' anomalies in arbitrarily distributed highly-dimensional data. A soft, or population, anomaly is characterized by a shift in the distribution of the data set, where certain elements appear with higher probability than anticipated. Such anomalies must be detected by considering a sufficiently large sample set rather than a single sample. Applications include, but not limited to, payment fraud trends, data exfiltration, disease clusters and epidemics, and social unrests. We evaluate the method on several domains and obtain both quantitative results and qualitative insights.

北京阿比特科技有限公司