CN110466911A - Automatic sorting garbage bin and classification method - Google Patents
Automatic sorting garbage bin and classification method Download PDFInfo
- Publication number
- CN110466911A CN110466911A CN201910276368.3A CN201910276368A CN110466911A CN 110466911 A CN110466911 A CN 110466911A CN 201910276368 A CN201910276368 A CN 201910276368A CN 110466911 A CN110466911 A CN 110466911A
- Authority
- CN
- China
- Prior art keywords
- garbage
- central axis
- box
- sorting
- gear
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000010813 municipal solid waste Substances 0.000 title claims abstract description 105
- 238000000034 method Methods 0.000 title claims abstract description 33
- 238000013461 design Methods 0.000 claims abstract description 7
- 238000012549 training Methods 0.000 claims description 20
- 238000013527 convolutional neural network Methods 0.000 claims description 11
- 238000012545 processing Methods 0.000 claims description 11
- 230000007306 turnover Effects 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 5
- 125000004122 cyclic group Chemical group 0.000 claims description 3
- 230000000717 retained effect Effects 0.000 claims description 2
- 238000005192 partition Methods 0.000 abstract description 6
- 239000002699 waste material Substances 0.000 abstract description 3
- 238000001514 detection method Methods 0.000 description 12
- 238000013473 artificial intelligence Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 238000012360 testing method Methods 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 3
- XEEYBQQBJWHFJM-UHFFFAOYSA-N Iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 239000004744 fabric Substances 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000009347 mechanical transmission Effects 0.000 description 2
- 230000001629 suppression Effects 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- -1 books Substances 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000004134 energy conservation Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 229910052742 iron Inorganic materials 0.000 description 1
- 235000021190 leftovers Nutrition 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000004064 recycling Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65F—GATHERING OR REMOVAL OF DOMESTIC OR LIKE REFUSE
- B65F1/00—Refuse receptacles; Accessories therefor
- B65F1/0033—Refuse receptacles; Accessories therefor specially adapted for segregated refuse collecting, e.g. receptacles with several compartments; Combination of receptacles
- B65F1/0053—Combination of several receptacles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65F—GATHERING OR REMOVAL OF DOMESTIC OR LIKE REFUSE
- B65F1/00—Refuse receptacles; Accessories therefor
- B65F1/14—Other constructional features; Accessories
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65F—GATHERING OR REMOVAL OF DOMESTIC OR LIKE REFUSE
- B65F2210/00—Equipment of refuse receptacles
- B65F2210/138—Identification means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65F—GATHERING OR REMOVAL OF DOMESTIC OR LIKE REFUSE
- B65F2210/00—Equipment of refuse receptacles
- B65F2210/172—Solar cells
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65F—GATHERING OR REMOVAL OF DOMESTIC OR LIKE REFUSE
- B65F2210/00—Equipment of refuse receptacles
- B65F2210/176—Sorting means
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02W—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO WASTEWATER TREATMENT OR WASTE MANAGEMENT
- Y02W30/00—Technologies for solid waste management
- Y02W30/10—Waste collection, transportation, transfer or storage, e.g. segregated refuse collecting, electric or hybrid propulsion
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Image Analysis (AREA)
Abstract
一种自动分类垃圾桶及分类方法。本发明基于YOLOV3技术架构进行设计自动分类垃圾桶,以便对垃圾进行分类回收利用,减少垃圾污染,同时最大成本回收利用废物。本发明设计有上下双层结构的垃圾桶,上层箱体设有垃圾丢入口,并安装有摄像头,上层箱体的上顶部设有隔层用于安装太阳能板、蓄电池,以满足系统的供电要求。摄像头捕捉投入的垃圾,利用识别算法对垃圾种类进行识别分类。下层箱体根据垃圾类别设计为双箱体或多箱体,两层箱体的连接处装有机械电动控制部分,使用两个舵机分别控制分类挡板和控制挡板的转动,以自动驱使垃圾落入其种类所对应的分类箱体内,本发明能够实现垃圾自动分类。
An automatic sorting trash bin and a sorting method. The present invention designs an automatic sorting trash can based on the YOLOV3 technical framework, so as to classify and recycle garbage, reduce garbage pollution, and recycle waste with maximum cost. The present invention is designed with an upper and lower double-layer trash can. The upper box body is provided with a garbage throwing inlet and a camera is installed. The upper top of the upper box body is provided with a partition for installing solar panels and batteries to meet the power supply requirements of the system. . The camera captures the input garbage, and uses the recognition algorithm to identify and classify the types of garbage. The lower box is designed as a double box or multiple boxes according to the garbage category. The connection between the two boxes is equipped with a mechanical and electric control part. Two steering gears are used to control the rotation of the sorting baffle and the control baffle to automatically drive The garbage falls into the sorting box corresponding to its type, and the invention can realize automatic garbage sorting.
Description
技术领域technical field
本发明涉及垃圾分类技术,具体而言涉及一种自动分类垃圾桶及分类方法。The invention relates to garbage sorting technology, in particular to an automatic sorting garbage bin and a sorting method.
背景技术Background technique
当代社会,节能减排是大家密切关注的话题,尤其在垃圾分类回收方面,更是目前社会最为突出的问题之一。生活中虽然大多都有使用分类垃圾桶,但是,根据调查与生活经验,使用者大多还是随意丢垃圾,不会根据垃圾类别将其丢进相应的垃圾箱。现有的分类垃圾桶中,各类垃圾仍然是混在一起无法区分的状态。这会造成无法对垃圾分类回收,造成资源的浪费。如果通过人工进行分拣,则会浪费大量人力财力。In contemporary society, energy conservation and emission reduction is a topic that everyone pays close attention to, especially in terms of garbage classification and recycling, which is one of the most prominent issues in society at present. Although most of the garbage bins are used in life, according to the survey and life experience, most users still throw garbage at will, and will not throw it into the corresponding garbage bin according to the type of garbage. In the existing sorting garbage bins, all kinds of garbage are still in an indistinguishable state of being mixed together. This will make it impossible to sort and recycle the garbage, resulting in a waste of resources. If sorting is carried out manually, a lot of human and financial resources will be wasted.
因此,目前需要一种结构简单、分类过程快捷高效的垃圾分类装置来解决上述问题。Therefore, there is a need for a garbage sorting device with a simple structure and a fast and efficient sorting process to solve the above problems.
发明内容Contents of the invention
本发明针对现有技术的不足,提供一种基于人工智能的自动分类垃圾桶、其电路系统及分类方法,以对投入垃圾桶的垃圾进行自动的识别与分类。本发明具体采用如下技术方案。Aiming at the deficiencies of the prior art, the present invention provides an artificial intelligence-based automatic sorting trash can, its circuit system and a sorting method, so as to automatically identify and classify the garbage put into the trash can. The present invention specifically adopts the following technical solutions.
首先,为实现上述目的,提出一种自动分类垃圾桶,其包括:筒身,其侧壁的上部设置有至少一个垃圾丢入口;第一舵机,固定于所述筒身侧壁的外部,其连接有水平中心轴柱,所述水平中心轴柱沿所述筒身的直径方向贯穿所述筒身的内部,所述水平中心轴柱由所述第一舵机驱动而旋转;控制挡板,包括至少两块,所述控制挡板分别连接所述水平中心轴柱,将所述筒身的内部分割为上、下两个箱体;所述控制挡板能够以所述水平中心轴柱为轴,随所述水平中心轴柱的旋转而翻转以打开或封闭所述上箱体的底部,使得所述上箱体内所容纳的物体落入所述下箱体;第二舵机,设置于所述上箱体的上顶部,其连接有垂直中心轴柱,所述垂直中心轴柱沿所述筒身的轴向贯穿所述上箱体的内部;所述垂直中心轴柱由所述第二舵机驱动而旋转;分类挡板,其中部连接所述垂直中心轴柱的下端,将所述上箱体分割为两部分,所述分类挡板能够以所述垂直中心轴柱为轴,随所述垂直中心轴柱的旋转而转动,以驱动所述上箱体内所容纳的物体移动至其分类所对应的控制挡板的上方;所述下箱体以所述水平中心轴柱为边界分割为多个分类箱体,每一块所述控制挡板分别对应有一个所述分类箱体,所述各分类箱体的上部分别由一块控制挡板封闭;摄像头,设置于所述上箱体的上顶部,用于采集所述上箱体内所容纳的物体的图像;控制板,获取所述摄像头所采集的图像,识别该图像中物体的种类,根据该物体的种类驱动所述第二舵机以通过所述垂直中心轴柱带动所述分类挡板,将上箱体内所容纳的该物体移动至其分类所对应的控制挡板的上方,而后驱动所述第一舵机以通过所述水平中心轴柱带动所述控制挡板翻转,使得该物体落入该控制挡板下与该物体的种类相对应的分类箱体内。First, in order to achieve the above object, an automatic sorting trash can is proposed, which includes: a barrel body, at least one garbage throwing inlet is arranged on the upper part of its side wall; a first steering gear is fixed on the outside of the side wall of the barrel body, It is connected with a horizontal central axis column, and the horizontal central axis column penetrates the inside of the cylinder body along the diameter direction of the cylinder body, and the horizontal central axis column is driven to rotate by the first steering gear; the control baffle , comprising at least two pieces, the control baffle is respectively connected to the horizontal central axis column, and divides the inside of the barrel body into upper and lower boxes; the control baffle can be connected with the horizontal central axis column is an axis, flipped with the rotation of the horizontal central axis column to open or close the bottom of the upper box, so that the objects contained in the upper box fall into the lower box; the second steering gear is set On the upper top of the upper box, it is connected with a vertical central axis column, and the vertical central axis column penetrates the inside of the upper box along the axial direction of the cylinder body; the vertical central axis column is formed by the The second steering gear is driven to rotate; the classification baffle, the middle of which is connected to the lower end of the vertical central axis column, divides the upper box into two parts, and the classification baffle can take the vertical central axis column as the axis , rotate with the rotation of the vertical central axis column to drive the objects contained in the upper box to move to the top of the control baffle corresponding to its classification; the lower box is based on the horizontal central axis column The boundary is divided into a plurality of classification boxes, each of the control baffles corresponds to one of the classification boxes, and the upper parts of the classification boxes are respectively closed by a control baffle; the camera is arranged in the upper box The upper top of the body is used to collect the image of the object contained in the upper box; the control board is used to obtain the image collected by the camera, identify the type of the object in the image, and drive the second object according to the type of the object. The steering gear drives the sorting baffle through the vertical central axis column, moves the object contained in the upper box to the top of the control baffle corresponding to its classification, and then drives the first steering gear to pass through the classification baffle. The horizontal central axis column drives the control baffle to turn over, so that the object falls into the classification box corresponding to the type of the object under the control baffle.
上述的自动分类垃圾桶中,还包括第一齿轮和第二齿轮;所述第一舵机与所述第一齿轮固定连接,所述第一齿轮与所述第二齿轮啮合以将所述第一舵机输出的驱动力传递至所述第二齿轮;所述水平中心轴柱包括两个,每一个所述水平中心轴柱分别连接有一个控制挡板;所述两个水平中心轴柱分别与所述第一齿轮和第二齿轮连接,所述两个水平中心轴柱分别由所述第一齿轮和第二齿轮驱动以带动其所连接的控制挡板翻转以打开或封闭所述上箱体的底部,使得所述上箱体内所容纳的物体落入所述下箱体中对应该物体种类的分类箱体内所述。The above-mentioned automatic sorting trash can also includes a first gear and a second gear; the first steering gear is fixedly connected with the first gear, and the first gear meshes with the second gear to turn the first gear The driving force output by a steering gear is transmitted to the second gear; the horizontal central axis column includes two, and each of the horizontal central axis columns is respectively connected with a control baffle; the two horizontal central axis columns are respectively Connected with the first gear and the second gear, the two horizontal central shaft columns are respectively driven by the first gear and the second gear to drive the connected control baffle to turn over to open or close the upper box The bottom of the body, so that the objects contained in the upper box fall into the classification box corresponding to the type of the object in the lower box.
可选的,上述的自动分类垃圾桶中,所述垃圾丢入口包括分别设置在两个控制挡板上侧的两个。Optionally, in the above-mentioned automatic sorting trash can, the garbage throwing inlets include two respectively arranged on the upper sides of the two control baffles.
可选的,上述的自动分类垃圾桶中,所述还包括:LED灯、蓄电池、太阳能板;所述LED灯、蓄电池、太阳能板以及所述控制板,均容纳于所述上箱体的上顶部。Optionally, in the above-mentioned automatic sorting trash bin, it also includes: LED lights, batteries, solar panels; the LED lights, batteries, solar panels and the control panel are all accommodated on the top of the upper box. top.
同时,为实现上述目的,本发明还提供一种自动垃圾分类方法,用于上述的自动分类垃圾桶,其步骤包括:第一步,在有物体进入所述上箱体时,通过所述摄像头采集该物体的图像;第二步,对所述图像进行去雾清晰增强处理;将所述图像的大小调整为32的整数倍;第三步,通过Yolo v3方法对处理后的图像进行循环卷积神经网络训练,以对所述处理后的图像中的物体进行种类识别;第四步,根据第三步中所识别的物体种类驱动所述第二舵机以通过所述垂直中心轴柱带动所述分类挡板,将上箱体内所容纳的该物体移动至其分类所对应的控制挡板的上方,而后驱动所述第一舵机以通过所述水平中心轴柱带动所述控制挡板翻转,使得该物体落入该控制挡板下与该物体的种类相对应的分类箱体内。At the same time, in order to achieve the above object, the present invention also provides an automatic garbage sorting method, which is used in the above-mentioned automatic sorting garbage can, the steps of which include: the first step, when an object enters the upper box, through the camera The image of the object is collected; the second step is to perform dehazing and clear enhancement processing on the image; the size of the image is adjusted to an integer multiple of 32; the third step is to circulate the processed image through the Yolo v3 method The product neural network is trained to carry out category identification to the object in the image after described processing; The fourth step, drives described second steering gear according to the object category identified in the third step to drive through the vertical central axis column The sorting baffle moves the object contained in the upper box to the top of the control baffle corresponding to its classification, and then drives the first steering gear to drive the control baffle through the horizontal central axis column Turn over so that the object falls into the classification box corresponding to the type of the object under the control baffle.
可选的,上述的自动垃圾分类方法中,所述第三步的具体步骤包括:步骤301,对第二步中所获得的图像进行网格划分;步骤302,利用k-means或IOU的方法获取对应上述网格的先验框anchor;步骤303,利用Darknet网络进行训练,将上述第二步中所获得的整张图像作为网络的输入,进行回归计算以在Darknet网络的输出层回归计算获得边界框boundingbox的位置及其所属的类别,计算其准确率;步骤304,利用NMS(非极大值抑制法)对上述所获得的边界框bounding box的位置、其所属的类别以及准确率进行过滤处理,过滤掉准确率低于设定阈值的边界框bounding box,根据保留的所述边界框bounding box所对应的边界框bounding box的位置、其所属的类别输出种类识别的结果。Optionally, in the above-mentioned automatic garbage classification method, the specific steps of the third step include: step 301, performing grid division on the image obtained in the second step; step 302, using the method of k-means or IOU Obtain the prior frame anchor corresponding to the above grid; step 303, use the Darknet network for training, use the entire image obtained in the second step above as the input of the network, and perform regression calculation to obtain the regression calculation at the output layer of the Darknet network The position of the bounding box and the category to which it belongs, and its accuracy rate is calculated; step 304, the position of the bounding box obtained above, its category and accuracy rate are filtered using NMS (non-maximum value suppression method) Processing, filtering out the bounding boxes whose accuracy rate is lower than the set threshold, and outputting the result of category recognition according to the position of the bounding box corresponding to the reserved bounding box and the category to which it belongs.
可选的,上述的自动垃圾分类方法中,所述循环卷积神经网络训练中,训练参数设置为:decay=0.005,learning_rate=0.001,steps=500000;所述循环卷积神经网络采用sum-squared error loss设计损失函数;所述损失函数中包含有位置坐标预测、含有物体的特征值预测、不含物体的特征值预测和类别预测。Optionally, in the above automatic garbage classification method, in the training of the circular convolutional neural network, the training parameters are set as: decay=0.005, learning_rate=0.001, steps=500000; the circular convolutional neural network adopts sum-squared error loss Design a loss function; the loss function includes position coordinate prediction, feature value prediction with objects, feature value prediction without objects, and category prediction.
有益效果Beneficial effect
本发明基于YOLOV3技术架构进行设计自动分类垃圾桶装置,以便对垃圾进行分类回收利用,减少垃圾污染,同时最大成本回收利用废物。本发明设计有上下双层结构的垃圾桶,上层箱体设置有垃圾丢入口,并安装有摄像头,上层箱体的上顶部设有隔层用于安装太阳能板、蓄电池,以满足系统的供电要求。摄像头捕捉投入的垃圾,利用识别算法对垃圾种类进行识别分类。下层箱体根据垃圾类别设计为双箱体或多箱体,两层箱体的连接处做机械电动控制部分,使用两个舵机分别控制控制挡板和分类挡板转动,以自动驱使垃圾落入其种类所对应的分类箱体内,本发明能够实现垃圾自动分类。The present invention designs an automatic sorting garbage can device based on the YOLOV3 technical framework, so as to classify and recycle garbage, reduce garbage pollution, and recycle waste at the maximum cost. The present invention is designed with an upper and lower double-layer trash can. The upper box body is provided with a garbage throwing inlet and a camera is installed. The upper top of the upper box body is provided with a partition for installing solar panels and batteries to meet the power supply requirements of the system. . The camera captures the input garbage, and uses the recognition algorithm to identify and classify the types of garbage. The lower box is designed as a double box or multiple boxes according to the garbage category. The connection between the two boxes is used as a mechanical and electric control part. Two steering gears are used to control the rotation of the control baffle and the classification baffle to automatically drive the garbage to fall. into the classification box corresponding to its type, the present invention can realize the automatic classification of garbage.
本发明的其它特征和优点将在随后的说明书中阐述,并且,部分地从说明书中变得显而易见,或者通过实施本发明而了解。Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention.
附图说明Description of drawings
附图用来提供对本发明的进一步理解,并且构成说明书的一部分,并与本发明的实施例一起,用于解释本发明,并不构成对本发明的限制。在附图中:The accompanying drawings are used to provide a further understanding of the present invention, and constitute a part of the description, and together with the embodiments of the present invention, are used to explain the present invention, and do not constitute a limitation to the present invention. In the attached picture:
图1是本发明所采用的YOLOV3物体识别方法中所用的Anchor预测边框位置的几何关系图;Fig. 1 is the geometric relationship diagram of the Anchor prediction frame position used in the YOLOV3 object recognition method adopted in the present invention;
图2是本发明的基于人工智能的自动垃圾分类方法的流程图;Fig. 2 is the flowchart of the automatic garbage sorting method based on artificial intelligence of the present invention;
图3是本发明利用YOLOV3物体识别方法所进行测试的识别结果图;Fig. 3 is the recognition result figure that the present invention utilizes YOLOV3 object recognition method to test;
图4是本发明的基于人工智能的自动分类垃圾桶的剖面图;Fig. 4 is the sectional view of the automatic sorting trash can based on artificial intelligence of the present invention;
图5是本发明的基于人工智能的自动分类垃圾桶的整体结构示意图;Fig. 5 is the overall structure schematic diagram of the automatic sorting trash can based on artificial intelligence of the present invention;
图6是本发明的基于人工智能的自动分类垃圾桶中第一舵机的驱动方式示意图;Fig. 6 is a schematic diagram of the driving mode of the first steering gear in the automatic sorting trash can based on artificial intelligence of the present invention;
图7是本发明的基于人工智能的自动分类垃圾桶中第二舵机的驱动方式示意图;Fig. 7 is a schematic diagram of the driving mode of the second steering gear in the automatic sorting garbage bin based on artificial intelligence of the present invention;
图8是本发明的基于人工智能的自动分类垃圾桶中电路系统的框图。Fig. 8 is a block diagram of the circuit system in the automatic sorting trash can based on artificial intelligence of the present invention.
图中,1表示筒身;11表示第一分类箱体;12表示第二分类箱体;2表示第一舵机;21表示第一齿轮;22表示第二齿轮;3表示水平中心轴柱;4表示控制挡板;5表示第二舵机;6表示垂直中心轴柱;7表示分类挡板;8表示垃圾丢入口。In the figure, 1 represents the cylinder body; 11 represents the first classification box; 12 represents the second classification case; 2 represents the first steering gear; 21 represents the first gear; 22 represents the second gear; 3 represents the horizontal central axis column; 4 represents the control baffle; 5 represents the second steering gear; 6 represents the vertical central axis column; 7 represents the sorting baffle; 8 represents the garbage throwing entrance.
具体实施方式Detailed ways
为使本发明实施例的目的和技术方案更加清楚,下面将结合本发明实施例的附图,对本发明实施例的技术方案进行清楚、完整地描述。显然,所描述的实施例是本发明的一部分实施例,而不是全部的实施例。基于所描述的本发明的实施例,本领域普通技术人员在无需创造性劳动的前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the purpose and technical solutions of the embodiments of the present invention more clear, the technical solutions of the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings of the embodiments of the present invention. Apparently, the described embodiments are some, not all, embodiments of the present invention. Based on the described embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
本技术领域技术人员可以理解,除非另外定义,这里使用的所有术语(包括技术术语和科学术语)具有与本发明所属领域中的普通技术人员的一般理解相同的意义。还应该理解的是,诸如通用字典中定义的那些术语应该被理解为具有与现有技术的上下文中的意义一致的意义,并且除非像这里一样定义,不会用理想化或过于正式的含义来解释。Those skilled in the art can understand that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It should also be understood that terms such as those defined in commonly used dictionaries should be understood to have a meaning consistent with the meaning in the context of the prior art, and will not be interpreted in an idealized or overly formal sense unless defined as herein explain.
本发明中所述的“内、外”的含义指的是相对于筒身本身而言,指向其内箱体的方向为内,反之为外;而非对本发明的装置机构的特定限定。The meanings of "inside and outside" in the present invention refer to that relative to the cylinder body itself, the direction pointing to the inner box is inward, and vice versa is outward; it is not a specific limitation to the device mechanism of the present invention.
本发明中所述的“连接”的含义可以是部件之间的直接连接也可以是部件间通过其它部件的间接连接。The meaning of "connection" in the present invention may be a direct connection between components or an indirect connection between components through other components.
本发明中所述的“上、下”的含义指的是使用者正对自动分类垃圾桶时,由舵机指向分类箱体的方向即为下,反之即为上,而非对本发明的装置机构的特定限定。The meaning of "up and down" in the present invention means that when the user is facing the automatic sorting trash can, the direction from the steering gear to the sorting box is down, and vice versa, it is up, not to the device of the present invention Institution-specific restrictions.
本发明的算法识别部分,首先对常见的可回收和不可回收垃圾进行图片采集,制作数据样本库,并对数据样本库打标签标记,进行训练。在随后的应用过程中,通过图像处理算法,利用上述训练结果对垃圾进行识别分类。此处识别算法拟采用yolov3算法,但不局限于这种算法。The algorithm identification part of the present invention first collects pictures of common recyclable and non-recyclable garbage, makes a data sample library, and marks the data sample library for training. In the subsequent application process, through the image processing algorithm, the above training results are used to identify and classify garbage. The recognition algorithm here intends to use the yolov3 algorithm, but it is not limited to this algorithm.
本发明主要基于YOLOV3物体识别算法开发一套自动智能分类垃圾桶装置,来帮助人们解决垃圾分类的难题,其中的难点在于垃圾的种类检测上,目前主流的目标检测算法主要有Faster R-CNN、YOLO、SSD等,YOLO在识别精度和速度上都有很好的效果,因此本发明采用YOLO网络模型进行设计可回收垃圾和不可回收垃圾自动分类装置,YOLO系列算法从v1到v3,各有其优缺点,YOLO的检测方式采用了端到端的思想,利用Darknet网络进行训练,模型将整张图作为网络的输入,它利用回归的方法直接在输出层回归bounding box(边界框)的位置及其所属的类别,正是这一点才与传统的识别算法不同,如RCNN采用proposal+classifier的思想,但是将提取proposal的步骤放在CNN中实现了,而YOLO则采用直接回归的思路。The present invention is mainly based on the YOLOV3 object recognition algorithm to develop a set of automatic intelligent classification garbage can device to help people solve the problem of garbage classification. The difficulty lies in the detection of garbage types. The current mainstream target detection algorithms mainly include Faster R-CNN, YOLO, SSD, etc., YOLO has a good effect on recognition accuracy and speed, so the present invention uses the YOLO network model to design an automatic classification device for recyclable garbage and non-recyclable garbage, and the YOLO series of algorithms have their own advantages from v1 to v3. Advantages and disadvantages, YOLO's detection method adopts the end-to-end idea, and uses the Darknet network for training. The model uses the entire image as the input of the network. It uses the regression method to directly return the position of the bounding box (boundary box) and its position in the output layer. The category it belongs to is different from traditional recognition algorithms. For example, RCNN adopts the idea of proposal+classifier, but puts the step of extracting proposal in CNN, while YOLO adopts the idea of direct regression.
具体而言,参考图4所示,本发明所提供的自动分类垃圾桶,利用上述的方式进行垃圾种类的识别以对垃圾进行分类。其整体分为箱体结构、机械传动部分、光伏供能部分三部分:Specifically, referring to FIG. 4 , the automatic sorting trash bin provided by the present invention utilizes the above-mentioned method to identify the type of garbage to classify the garbage. The whole is divided into three parts: the box structure, the mechanical transmission part, and the photovoltaic energy supply part:
筒身1,其侧壁的上部设置有至少一个,或相对的两个垃圾丢入口8;筒身1设置为两箱体的结构,整体为圆柱体型,由控制挡板分开,将其分为上下两层(上箱体和下箱体);垃圾丢入口8设置在离控制挡板10cm处:The upper part of the cylinder body 1 is provided with at least one, or two opposite garbage disposal inlets 8; the cylinder body 1 is provided with a structure of two boxes, and the whole is cylindrical, separated by a control baffle, which is divided into There are upper and lower floors (upper box and lower box); the garbage disposal entrance 8 is set at 10cm away from the control baffle:
上箱体包括垃圾分类装置和电源CPU控制部分。垃圾分类装置由分类挡板和控制挡板组成。其结构示意图如图5所示,控制挡板4,包括至少两块,分别设置在两个垃圾丢入口8下方;所述控制挡板4分别连接所述水平中心轴柱3,将所述筒身1的内部分割为上、下两个箱体;所述控制挡板4能够以所述水平中心轴柱3为轴,随所述水平中心轴柱3的旋转而翻转以打开或封闭所述上箱体的底部,使得所述上箱体内所容纳的物体落入所述下箱体。具体而言,由齿轮固定控制的水平中心轴柱控制的两块半圆形控制挡板水平放置,其由第一舵机2控制。The upper box includes the garbage sorting device and the CPU control part of the power supply. The garbage sorting device is composed of a sorting baffle and a control baffle. Its structural diagram is shown in Figure 5, the control baffle 4 includes at least two pieces, which are respectively arranged below the two garbage throwing inlets 8; the control baffle 4 is respectively connected to the horizontal central axis column 3, and the cylinder The interior of the body 1 is divided into upper and lower boxes; the control baffle 4 can take the horizontal central axis column 3 as the axis, and turn over with the rotation of the horizontal central axis column 3 to open or close the the bottom of the upper box so that the objects contained in the upper box fall into the lower box. Specifically, two semicircular control baffles controlled by a horizontal central axis column controlled by fixed gears are placed horizontally, which are controlled by the first steering gear 2 .
下箱体是一个两箱体结构。由一块垂直放置的中心隔板从中心隔开,中心隔板放置方向与水平中心轴柱平行。两个箱体之间放置一个半圆形的垃圾收集桶,用于分类后的垃圾收集。The lower box is a two-box structure. It is separated from the center by a vertically placed central partition, and the central partition is placed in a direction parallel to the horizontal central axis column. A semicircular garbage collection bin is placed between the two boxes for sorted garbage collection.
上述的第一舵机2,固定于所述筒身1侧壁的外部,其连接有水平中心轴柱3,所述水平中心轴柱3沿所述筒身1的直径方向贯穿所述筒身1的内部,所述水平中心轴柱3由所述第一舵机2驱动而旋转。The above-mentioned first steering gear 2 is fixed on the outside of the side wall of the cylinder body 1, and is connected with a horizontal central axis column 3, and the horizontal central axis column 3 penetrates the cylinder body along the diameter direction of the cylinder body 1 1, the horizontal central shaft column 3 is driven by the first steering gear 2 to rotate.
上述的第二舵机5,设置于所述上箱体的上顶部,其连接有垂直中心轴柱6,所述垂直中心轴柱6沿所述筒身1的轴向贯穿所述上箱体的内部;所述垂直中心轴柱6由所述第二舵机5驱动而旋转;其中,所述第一舵机2和所述第二舵机5可选择为MG995型号舵机The above-mentioned second steering gear 5 is arranged on the upper top of the upper box, and it is connected with a vertical central axis column 6, and the vertical central axis column 6 penetrates the upper box along the axial direction of the cylinder body 1 inside; the vertical central axis column 6 is driven to rotate by the second steering gear 5; wherein, the first steering gear 2 and the second steering gear 5 can be selected as MG995 type steering gear
分类挡板7,参考图7,其中部连接所述垂直中心轴柱6的下端,将所述上箱体分割为两部分,所述分类挡板7能够以所述垂直中心轴柱6为轴,随所述垂直中心轴柱6的旋转而转动,以驱动所述上箱体内所容纳的物体移动至其分类所对应的控制挡板4的上方;也就是说,分类挡板由第二舵机5控制,垂直放置在控制挡板上方,放置方向和水平中心轴柱平行,分类挡板中心所设置的一根垂直中心轴柱,固定在舵机2转轴上,通过控制舵机转向控制分类挡板转向分类垃圾。Classification baffle 7, with reference to Fig. 7, its middle part connects the lower end of described vertical central axis column 6, and described upper box body is divided into two parts, and described classification baffle 7 can take described vertical central axis column 6 as axis , to rotate with the rotation of the vertical central axis column 6, to drive the objects contained in the upper box to move to the top of the control baffle 4 corresponding to its classification; that is to say, the classification baffle is controlled by the second rudder Machine 5 is controlled, placed vertically above the control baffle, and the placement direction is parallel to the horizontal central axis column. A vertical central axis column set in the center of the classification baffle is fixed on the rotating shaft of the steering gear 2, and the classification is controlled by controlling the steering gear steering. The flapper turns to sort the trash.
所述下箱体以所述水平中心轴柱3为边界分割为多个分类箱体,每一块所述控制挡板4分别对应有一个所述分类箱体,所述各分类箱体的上部分别由一块控制挡板4封闭;The lower box is divided into a plurality of classification boxes with the horizontal central axis column 3 as the boundary, each of the control baffles 4 corresponds to one of the classification boxes, and the upper parts of the classification boxes are respectively Closed by a control baffle 4;
摄像头,设置于所述上箱体的上顶部,用于采集所述上箱体内所容纳的物体的图像;a camera, arranged on the upper top of the upper box, for collecting images of objects contained in the upper box;
参考图8,由于垃圾桶应用场地和环境的多样化,室外垃圾桶电路部分还可在所述上箱体的上顶部还设置有LED灯、蓄电池、太阳能板以及控制板。其中,垃圾桶顶部和舵机2所安装的隔板用于安装上述的太阳能板以作为光伏发电电源,上述隔板还用于安装控制板部分。所述太阳能板的输出端连接所述蓄电池,所述蓄电池为所述摄像头、LED灯、控制板、所述第一舵机2以及所述第二舵机5供电;由此,本发明利用太阳能电池板白天接受太阳辐射能并且使其转换为电能经过控制器存在蓄电池中,对系统进行自我能量供应,实现能量的自给自足,在不接外部电源的情况下依然可以工作;Referring to Figure 8, due to the diversification of the application site and environment of the garbage can, the circuit part of the outdoor garbage can can also be provided with LED lights, batteries, solar panels and control panels on the upper top of the upper box. Wherein, the partition plate installed on the top of the trash can and the steering gear 2 is used to install the above-mentioned solar panel as a photovoltaic power supply, and the above-mentioned partition board is also used to install the control panel part. The output terminal of the solar panel is connected to the storage battery, and the storage battery supplies power for the camera, the LED lamp, the control board, the first steering gear 2 and the second steering gear 5; thus, the present invention utilizes solar energy During the day, the battery panel receives solar radiation energy and converts it into electrical energy and stores it in the battery through the controller, which supplies the system with self-energy, realizes energy self-sufficiency, and can still work without external power supply;
控制板包括有:图像接收单元,其连接所述摄像头,用于获取所述摄像头所采集的图像;图像处理单元,用于处理所述图像,识别该图像中物体的种类;舵机控制单元,其连接所述第一舵机2和所述第二舵机5,用于根据图像处理单元所识别的该物体的种类驱动所述第二舵机5以通过所述垂直中心轴柱6带动所述分类挡板7,将上箱体内所容纳的该物体移动至其分类所对应的控制挡板4的上方,而后驱动所述第一舵机2以通过所述水平中心轴柱3带动所述控制挡板4翻转,使得该物体落入该控制挡板4下与该物体的种类相对应的分类箱体内。The control board includes: an image receiving unit, which is connected to the camera, and is used to obtain the image collected by the camera; an image processing unit, which is used to process the image and identify the type of object in the image; a steering gear control unit, It is connected to the first steering gear 2 and the second steering gear 5, and is used to drive the second steering gear 5 according to the type of the object recognized by the image processing unit so as to drive all the steering gears through the vertical central axis column 6. The classification baffle 7 moves the object contained in the upper box to the top of the control baffle 4 corresponding to its classification, and then drives the first steering gear 2 to drive the object through the horizontal central axis column 3 The control baffle 4 is overturned so that the object falls into the classification box corresponding to the type of the object under the control baffle 4 .
参考图6所示,在一种较佳的实现方式下,所述水平中心轴柱3设计为两根,分别控制两个控制挡板,其分别通过第一齿轮21和第二齿轮22提供驱动。其中:As shown in FIG. 6, in a preferred implementation mode, the horizontal central shaft column 3 is designed to be two, respectively controlling two control baffles, which are respectively driven by the first gear 21 and the second gear 22. . in:
所述第一舵机2与所述第一齿轮21固定连接,所述第一齿轮21与所述第二齿轮22啮合以将所述第一舵机2输出的驱动力传递至所述第二齿轮22;The first steering gear 2 is fixedly connected to the first gear 21, and the first gear 21 meshes with the second gear 22 to transmit the driving force output by the first steering gear 2 to the second gear. gear 22;
所述水平中心轴柱3包括两个,每一个所述水平中心轴柱3分别连接有一个控制挡板4;所述两个水平中心轴柱3分别与所述第一齿轮21和第二齿轮22连接,所述两个水平中心轴柱3分别由所述第一齿轮21和第二齿轮22驱动以带动其所连接的控制挡板4翻转以打开或封闭所述上箱体的底部,使得所述上箱体内所容纳的物体落入所述下箱体中对应该物体种类的分类箱体内。The horizontal central axis column 3 includes two, and each of the horizontal central axis columns 3 is respectively connected with a control baffle plate 4; the two horizontal central axis columns 3 are respectively connected with the first gear 21 and the second gear 22 connection, the two horizontal central shaft columns 3 are respectively driven by the first gear 21 and the second gear 22 to drive the connected control baffle 4 to turn over to open or close the bottom of the upper box, so that The objects contained in the upper box fall into the sorting boxes corresponding to the types of objects in the lower box.
上述机械传动采用舵机控制,舵机是一个微型的伺服系统,其工作原理是控制电路接收信号源的控制脉冲,并驱动电机转动;齿轮组将电机的速度成大倍数缩小,并将电机的输出扭矩放大响应倍数,然后输出;电位器和齿轮组的末级一起转动,测量舵机轴转动角度;电路板检测并根据电位器判断舵机转动角度,然后控制舵机转动到目标角度或保持在目标角度。采用舵机控制在控制精度和速度上有很好的效果。本发明采用的是MG995型号舵机,MG995舵机稳定性好、控制精度更高,能稳定精确的控制分类挡板转向分类和控制挡板的打开和关闭。控制挡板由第一舵机2控制,使用两个齿轮将两块控制挡板中心轴柱啮合,达到同步控制的效果。示意图如图6所示,第二舵机5控制分类挡板,负责将垃圾正确归类。将舵机轴与分类挡板中心轴柱固定在一起,通过控制舵机转动来控制分类挡板的工作The above-mentioned mechanical transmission is controlled by a steering gear. The steering gear is a micro servo system. Its working principle is that the control circuit receives the control pulse from the signal source and drives the motor to rotate; the gear set reduces the speed of the motor by a large multiple and reduces the speed of the motor. The output torque is amplified by the response multiple, and then output; the potentiometer and the final stage of the gear set rotate together to measure the rotation angle of the steering gear shaft; the circuit board detects and judges the rotation angle of the steering gear according to the potentiometer, and then controls the steering gear to rotate to the target angle or maintain at the target angle. The use of steering gear control has a good effect on control accuracy and speed. What the present invention adopts is MG995 steering gear, and MG995 steering gear has good stability and higher control precision, and can stably and accurately control the sorting baffle to turn to sorting and control the opening and closing of the baffle. The control baffle is controlled by the first steering gear 2, and two gears are used to mesh the central shafts of the two control baffles to achieve the effect of synchronous control. As shown in Figure 6, the second steering gear 5 controls the sorting baffle and is responsible for correctly sorting the garbage. Fix the shaft of the steering gear and the central shaft column of the sorting baffle, and control the work of the sorting baffle by controlling the rotation of the steering gear
上述垃圾桶的控制板对垃圾进行分类的步骤具体可参考图2所示,包括:The steps for the control panel of the above-mentioned garbage bin to classify the garbage can be referred to in Figure 2, including:
第一步,在有物体进入所述上箱体时,通过所述摄像头采集该物体的图像;In the first step, when an object enters the upper box, the image of the object is collected by the camera;
第二步,对所述图像进行去雾清晰增强处理;将所述图像的大小调整为32的整数倍;The second step is to perform dehazing and clear enhancement processing on the image; adjust the size of the image to an integer multiple of 32;
第三步,通过YOLO v3方法对处理后的图像进行循环卷积神经网络训练,以对所述处理后的图像中的物体进行种类识别;其步骤具体为:The third step is to carry out cyclic convolutional neural network training on the processed image by the YOLO v3 method, so as to carry out category recognition to the objects in the processed image; the steps are specifically:
步骤301,对第二步中所获得的图像进行网格划分;Step 301, performing grid division on the image obtained in the second step;
步骤302,利用k-means或IOU的方法获取对应上述网格的先验框anchor;Step 302, using the method of k-means or IOU to obtain the prior frame anchor corresponding to the above grid;
步骤303,利用Darknet网络进行训练,将上述第二步中所获得的整张图像作为网络的输入,进行回归计算以在Darknet网络的输出层回归计算获得边界框bounding box的位置及其所属的类别,计算其准确率;Step 303, use the Darknet network for training, use the entire image obtained in the second step above as the input of the network, and perform regression calculation to obtain the position of the bounding box and its category at the output layer of the Darknet network , calculate its accuracy rate;
步骤304,利用NMS对上述所获得的边界框bounding box的位置、其所属的类别以及准确率进行过滤处理,过滤掉准确率低于设定阈值的边界框bounding box,根据保留的所述边界框bounding box所对应的边界框bounding box的位置、其所属的类别输出种类识别的结果;Step 304, use NMS to filter the position of the bounding box, its category and accuracy rate obtained above, filter out the bounding box whose accuracy rate is lower than the set threshold, and filter out the bounding box according to the retained bounding box The position of the bounding box corresponding to the bounding box, the category to which it belongs, and the output category recognition result;
第四步,根据第三步中所识别的物体种类驱动所述第二舵机5以通过所述垂直中心轴柱6带动所述分类挡板7,将上箱体内所容纳的该物体移动至其分类所对应的控制挡板4的上方,而后驱动所述第一舵机2以通过所述水平中心轴柱3带动所述控制挡板4翻转,使得该物体落入该控制挡板4下与该物体的种类相对应的分类箱体内。The fourth step is to drive the second steering gear 5 according to the type of object identified in the third step to drive the sorting baffle 7 through the vertical central axis column 6, and move the object contained in the upper box to the Above the control baffle 4 corresponding to its classification, and then drive the first steering gear 2 to drive the control baffle 4 to turn over through the horizontal central axis column 3, so that the object falls under the control baffle 4 Inside the classification box corresponding to the type of the object.
上述垃圾桶主要利用图像目标检测框架对垃圾桶中的垃圾种类进行识别检测,在垃圾桶入口处装有摄像头,当物体丢入时,触动摄像头进行拍照,在利用检测算法对拍取的照片进行检测,由于应用对象是垃圾桶,其运作的快速性很重要,要做到及时响应。本发明保证了算法的实时性,下面对本发明的实施过程做进一步描述,具体如下:The above-mentioned trash can mainly uses the image target detection framework to identify and detect the types of garbage in the trash can. A camera is installed at the entrance of the trash can. When an object is thrown in, the camera is touched to take a photo. For detection, since the application object is a trash can, the speed of its operation is very important, and it is necessary to respond in a timely manner. The present invention has guaranteed the real-time property of algorithm, below the implementation process of the present invention is described further, specifically as follows:
1、当检测到有垃圾丢入时,触动摄像头进行拍照,并对图片进行去雾清晰增强处理,以便获得质量更好的图片,使得后期的训练网络获得更好的图像特征,增加结果的准确度。此处的图像增强网络可以使用GAN网络,但不局限于这一种方法。1. When it is detected that there is garbage thrown in, touch the camera to take a picture, and perform dehazing and clear enhancement processing on the picture, so as to obtain a better quality picture, so that the later training network can obtain better image features and increase the accuracy of the result Spend. The image enhancement network here can use the GAN network, but is not limited to this method.
2、本发明是基于人工智能的自动分类垃圾桶,本发明采用拍取照片和上网搜索两种手段,采集了常见了可回收垃圾(塑料瓶、布料、书本、铁丝)和不可回收垃圾(果皮、碎玻璃、剩饭、餐巾纸)共计2667张图片,构成本发明的数据样本库,对数据集进行打标签标记,使得训练结果更加准确。2. The present invention is an automatic sorting garbage bin based on artificial intelligence. The present invention adopts two means of taking photos and searching the Internet to collect common recyclable garbage (plastic bottles, cloth, books, iron wire) and non-recyclable garbage (fruit peels). , Broken glass, leftovers, napkins) a total of 2667 pictures constitute the data sample library of the present invention, and the data set is tagged to make the training result more accurate.
3、准备好数据集后,利用循环卷积神经网络进行训练,其中一些训练参数设置如下,decay=0.005,learning_rate=0.001,steps=500000,训练在GPU上进行。在第2步中,图片尺寸需要处理为32的倍数,是因为YOLO v3有5次下采样,每次采样步长为2,所以网络的最大步幅(步幅指层的输入大小除以输出)为2^5=32。在实现中,最主要的就是怎么设计损失函数,本发明算法中采用了sum-squared error loss设计损失函数,其最终的损失函数如下:3. After preparing the data set, use the circular convolutional neural network for training. Some of the training parameters are set as follows, decay=0.005, learning_rate=0.001, steps=500000, and the training is performed on the GPU. In the second step, the picture size needs to be processed as a multiple of 32, because YOLO v3 has 5 downsampling, each sampling step is 2, so the maximum stride of the network (the stride refers to the input size of the layer divided by the output ) is 2^5=32. In the implementation, the most important thing is how to design the loss function. The algorithm of the present invention uses sum-squared error loss to design the loss function. The final loss function is as follows:
这个损失函数中,主要分为四部分,坐标预测、含有物体(object)的特征值(confidence)预测、不含物体(object)的特征值(confidence)预测和类别预测,利用损失函数进行约束训练网络。In this loss function, it is mainly divided into four parts, coordinate prediction, eigenvalue (confidence) prediction with object (object), eigenvalue (confidence) prediction without object (object) and category prediction, using loss function for constraint training network.
4、利用YOLOV3算法检测,需要获得anchor(先验框),具体可在采集的数据集上利用k-means、IOU等方法重新得到新的anchor,但不限于这两种方法。Anchor机制指的是对每个栅格设置一些参考的边框形状及尺寸,检测时只要对参考边框进行精修即可,代替了整张图像的位置回归。4. Using the YOLOV3 algorithm to detect, it is necessary to obtain the anchor (a priori frame). Specifically, a new anchor can be obtained by using k-means, IOU and other methods on the collected data set, but it is not limited to these two methods. The Anchor mechanism refers to setting some reference frame shapes and sizes for each grid. It only needs to refine the reference frame during detection, instead of the position regression of the entire image.
使用Anchor机制首先要确定参考边框的宽高维度。虽然网络训练的过程也会调整边框的宽高维度,最终得到准确的边框,但如果一开始就选择更有代表性的参考边框,那么网络能更容易检测到准确的位置。卷积神经网络在每一个单元格上会为每一个边界框预测4个值,即坐标(x,y)与目标的宽w和高h,分别记为xt,yt,wt,ht。若目标中心在单元格中相对于图像左上角有偏移(xc,yc),并且锚点框具有高度和宽度wp,hp,则修正后的边界框如图1所示。其中To use the Anchor mechanism, first determine the width and height dimensions of the reference frame. Although the network training process will also adjust the width and height dimensions of the frame, and finally get an accurate frame, but if a more representative reference frame is selected from the beginning, it will be easier for the network to detect the exact position. The convolutional neural network will predict 4 values for each bounding box on each cell, namely the coordinates (x, y) and the width w and height h of the target, which are recorded as xt, yt, wt, ht respectively. If the center of the object is offset (xc, yc) in the cell relative to the upper left corner of the image, and the anchor box has height and width wp, hp, the corrected bounding box is shown in Figure 1. in
bx=σ(tx)+cx b x =σ(t x )+c x
by=σ(ty)+cy b y =σ(t y )+c y
5、利用YOLOv3算法对提取的图片进行识别,并且标注出物体的类别与位置。具体做法如下:5. Use the YOLOv3 algorithm to identify the extracted pictures, and mark the category and location of the object. The specific method is as follows:
利用NMS(非极大值抑制法)进行过滤处理,经过卷积网络训练后,在测试的时候,每个网格预测的类别(class)信息和bounding box预测的confidence信息相乘,就得到每个bounding box的类别信息和准确率信息(class-specific confidence score):Use NMS (Non-Maximum Suppression Method) for filtering processing. After convolutional network training, when testing, the class information predicted by each grid is multiplied by the confidence information predicted by the bounding box to get each Category information and accuracy information (class-specific confidence score) of a bounding box:
等式左边第一项就是每个网格预测的类别信息,第二、三项就是每个boundingbox预测的confidence。得到每个box的类别信息和准确率信息(class-specificconfidence score)以后,设置阈值,滤掉得分低的boxes,对保留的boxes进行NMS处理,就得到最终的检测结果。The first item on the left side of the equation is the category information predicted by each grid, and the second and third items are the confidence predicted by each boundingbox. After obtaining the category information and accuracy information (class-specificconfidence score) of each box, set the threshold, filter out the boxes with low scores, and perform NMS processing on the reserved boxes to obtain the final detection result.
由此,本发明巧妙使用了YOLOv3算法多尺度检测的原理,对垃圾的检测精度很高,尤其当垃圾较小时,yolov3对于小物体的识别有很好的精度,这样不会存在垃圾漏检,少检情况出现,同时运用anchor box的方法在不改变mAP的情况下增加了recall,而使用新的网络结构则减少了33%的计算。速度要快过其他检测系统(FasterR-CNN,ResNet,SSD),改善了召回率和准确率,提升定位的准确度,同时保持分类的准确度。随着网络的加深和多个模型的结合,可以使得训练准确度得到提高,同时对图片进行数据增强,使得提取特征更加显著,图片质量更高。其识别结果如图3所示。Therefore, the present invention cleverly uses the principle of multi-scale detection of the YOLOv3 algorithm, and the detection accuracy of garbage is very high, especially when the garbage is small, yolov3 has a good accuracy in identifying small objects, so that there will be no missed detection of garbage, The situation of under-inspection occurs, and the method of using the anchor box increases the recall without changing the mAP, and the use of the new network structure reduces the calculation by 33%. The speed is faster than other detection systems (FasterR-CNN, ResNet, SSD), which improves the recall rate and accuracy rate, improves the accuracy of positioning, and maintains the accuracy of classification. With the deepening of the network and the combination of multiple models, the training accuracy can be improved. At the same time, the data of the picture is enhanced to make the extracted features more significant and the picture quality higher. The recognition results are shown in Figure 3.
由此,本发明在训练好数据库后,将生成的模型文件调用,应用yolov3算法框架进行垃圾图片检测测试,具体测试结果如图3所示,分别对书本、塑料瓶、餐巾纸、碎玻璃、铁丝、果皮、塑料袋和布料进行了测试,具体识别图如图3所示,蓝色框体表示物体的位置,左上角红色字有物体的标签和对应的正确率,可以看出,识别效果良好,能很好的满足智能垃圾桶的工作要求。Thus, after the database is trained, the present invention calls the generated model file, and applies the yolov3 algorithm framework to carry out the garbage picture detection test. The specific test results are shown in FIG. , fruit peel, plastic bag and cloth were tested. The specific recognition diagram is shown in Figure 3. The blue box indicates the position of the object, and the red word in the upper left corner has the label of the object and the corresponding accuracy rate. It can be seen that the recognition effect is good. , can well meet the working requirements of the smart trash can.
以上仅为本发明的实施方式,其描述较为具体和详细,但并不能因此而理解为对本发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变形和改进,这些均属于本发明的保护范围。The above is only the embodiment of the present invention, and its description is relatively specific and detailed, but it should not be construed as limiting the patent scope of the present invention. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present invention, and these all belong to the protection scope of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910276368.3A CN110466911A (en) | 2019-04-08 | 2019-04-08 | Automatic sorting garbage bin and classification method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910276368.3A CN110466911A (en) | 2019-04-08 | 2019-04-08 | Automatic sorting garbage bin and classification method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110466911A true CN110466911A (en) | 2019-11-19 |
Family
ID=68507348
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910276368.3A Pending CN110466911A (en) | 2019-04-08 | 2019-04-08 | Automatic sorting garbage bin and classification method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110466911A (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111517034A (en) * | 2020-05-09 | 2020-08-11 | 安徽工程大学 | A kind of automatic classification trash can and its classification method and system |
CN112158486A (en) * | 2020-08-28 | 2021-01-01 | 山东科技大学 | Intelligent garbage classification device and classification method |
CN112560576A (en) * | 2020-11-09 | 2021-03-26 | 华南农业大学 | AI map recognition garbage classification and intelligent recovery method |
CN112660655A (en) * | 2020-12-10 | 2021-04-16 | 成都工业学院 | Intelligent classification garbage bin based on degree of depth study |
CN112949668A (en) * | 2019-12-10 | 2021-06-11 | 东北大学秦皇岛分校 | Garbage detection system based on deep learning |
CN113636242A (en) * | 2021-08-27 | 2021-11-12 | 阿尔飞思(昆山)智能物联科技有限公司 | Sorting mechanism and garbage sorting device |
CN115417025A (en) * | 2022-08-12 | 2022-12-02 | 广州大学 | Intelligent garbage classification method, device and storage medium for distributed processing |
CN115599132A (en) * | 2022-10-25 | 2023-01-13 | 上海莘汭驱动技术有限公司(Cn) | Platform angle control method controlled by double electric rudders |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20130091449A (en) * | 2012-02-08 | 2013-08-19 | 조연재 | Anti-theft and sticky paint. |
WO2014179667A2 (en) * | 2013-05-03 | 2014-11-06 | Ecowastehub Corp. | Solid waste identification & segregation system |
CN205837716U (en) * | 2016-07-20 | 2016-12-28 | 李便桧 | A kind of classification garbage can |
CN106395186A (en) * | 2016-12-05 | 2017-02-15 | 上海商溱环保节能科技有限公司 | Intelligent urban waste bin |
CN106742964A (en) * | 2017-03-16 | 2017-05-31 | 黄驿钦 | Rubbish magazine |
CN108182455A (en) * | 2018-01-18 | 2018-06-19 | 齐鲁工业大学 | A kind of method, apparatus and intelligent garbage bin of the classification of rubbish image intelligent |
CN207618355U (en) * | 2017-12-19 | 2018-07-17 | 河海大学 | A kind of down town intelligent classification dustbin |
CN108357817A (en) * | 2018-02-24 | 2018-08-03 | 浙江夏远信息技术有限公司 | A kind of intelligent environmental-protection garbage bin alarmed |
CN208022172U (en) * | 2018-03-12 | 2018-10-30 | 郑州大学 | A kind of rubbish from cooking collection device |
CN208165794U (en) * | 2017-11-14 | 2018-11-30 | 中国矿业大学 | A kind of intelligent classification dustbin |
CN109305490A (en) * | 2018-10-14 | 2019-02-05 | 天津大学 | An intelligent sorting garbage bin based on image recognition technology |
-
2019
- 2019-04-08 CN CN201910276368.3A patent/CN110466911A/en active Pending
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20130091449A (en) * | 2012-02-08 | 2013-08-19 | 조연재 | Anti-theft and sticky paint. |
WO2014179667A2 (en) * | 2013-05-03 | 2014-11-06 | Ecowastehub Corp. | Solid waste identification & segregation system |
CN205837716U (en) * | 2016-07-20 | 2016-12-28 | 李便桧 | A kind of classification garbage can |
CN106395186A (en) * | 2016-12-05 | 2017-02-15 | 上海商溱环保节能科技有限公司 | Intelligent urban waste bin |
CN106742964A (en) * | 2017-03-16 | 2017-05-31 | 黄驿钦 | Rubbish magazine |
CN208165794U (en) * | 2017-11-14 | 2018-11-30 | 中国矿业大学 | A kind of intelligent classification dustbin |
CN207618355U (en) * | 2017-12-19 | 2018-07-17 | 河海大学 | A kind of down town intelligent classification dustbin |
CN108182455A (en) * | 2018-01-18 | 2018-06-19 | 齐鲁工业大学 | A kind of method, apparatus and intelligent garbage bin of the classification of rubbish image intelligent |
CN108357817A (en) * | 2018-02-24 | 2018-08-03 | 浙江夏远信息技术有限公司 | A kind of intelligent environmental-protection garbage bin alarmed |
CN208022172U (en) * | 2018-03-12 | 2018-10-30 | 郑州大学 | A kind of rubbish from cooking collection device |
CN109305490A (en) * | 2018-10-14 | 2019-02-05 | 天津大学 | An intelligent sorting garbage bin based on image recognition technology |
Non-Patent Citations (2)
Title |
---|
JOSEPH REDMON ET AL.: "YOLOv3:An Incremental Improvement", 《HTTPS://ARXIV.ORG/ABS/1490.1556V6》 * |
丁鑫: "基于深度卷积网络特征优化的图像分类", 《中国优秀硕士学位论文全文数据库 信息科技I辑》 * |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112949668A (en) * | 2019-12-10 | 2021-06-11 | 东北大学秦皇岛分校 | Garbage detection system based on deep learning |
CN111517034A (en) * | 2020-05-09 | 2020-08-11 | 安徽工程大学 | A kind of automatic classification trash can and its classification method and system |
CN112158486A (en) * | 2020-08-28 | 2021-01-01 | 山东科技大学 | Intelligent garbage classification device and classification method |
CN112560576A (en) * | 2020-11-09 | 2021-03-26 | 华南农业大学 | AI map recognition garbage classification and intelligent recovery method |
CN112660655A (en) * | 2020-12-10 | 2021-04-16 | 成都工业学院 | Intelligent classification garbage bin based on degree of depth study |
CN112660655B (en) * | 2020-12-10 | 2022-11-29 | 成都工业学院 | Intelligent classification garbage bin based on degree of depth study |
CN113636242A (en) * | 2021-08-27 | 2021-11-12 | 阿尔飞思(昆山)智能物联科技有限公司 | Sorting mechanism and garbage sorting device |
CN115417025A (en) * | 2022-08-12 | 2022-12-02 | 广州大学 | Intelligent garbage classification method, device and storage medium for distributed processing |
CN115417025B (en) * | 2022-08-12 | 2024-01-12 | 广州大学 | Intelligent garbage classification method, device and storage medium for distributed processing |
CN115599132A (en) * | 2022-10-25 | 2023-01-13 | 上海莘汭驱动技术有限公司(Cn) | Platform angle control method controlled by double electric rudders |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109928107B (en) | An Automatic Classification System | |
CN110466911A (en) | Automatic sorting garbage bin and classification method | |
CN108182455A (en) | A kind of method, apparatus and intelligent garbage bin of the classification of rubbish image intelligent | |
CN110316496A (en) | A kind of intelligent garbage identification sorter Internet-based | |
CN110937280B (en) | Audio-visual combination based intelligent garbage classification and recovery method and terminal | |
CN110902188B (en) | An intelligent garbage sorting garbage bin | |
CN104609064A (en) | Automatic sorting garbage can and sorting method | |
CN103991660A (en) | Intelligent weighing sorting dustbin | |
CN109305490B (en) | Intelligent classification dustbin based on image recognition technology | |
CN113213005A (en) | Automatic change refuse classification processing apparatus | |
CN110076782A (en) | A kind of intelligence control garbage classification machine people of computer vision target identification | |
CN113003037B (en) | An intelligent waste sorting system based on cross-belt sorting structure | |
CN113291666A (en) | Novel intelligent classification dustbin and working method thereof | |
CN111731718A (en) | A kind of intelligent classification processing trash can and operation method thereof | |
CN114572587B (en) | Compact intelligent classification dustbin and working method thereof | |
CN110155556A (en) | An intelligent sorting trash can | |
CN110803406A (en) | Deep learning-based intelligent classification of garbage cans | |
CN211544683U (en) | Intelligent classification response garbage bin based on vision technique | |
CN214297580U (en) | An Internet-based intelligent garbage identification and classification device | |
CN111361889A (en) | Intelligent garbage can and control method thereof | |
CN212607180U (en) | Triangular intelligent garbage can | |
CN216271182U (en) | Novel intelligent classification dustbin | |
CN212654886U (en) | A garbage automatic sorting bucket based on Raspberry Pi control | |
CN210285451U (en) | Automatic classification garbage can and management system thereof | |
CN111319888A (en) | Garbage classification method suitable for triangular garbage can and triangular intelligent garbage can |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |