SCIQ1金融顶刊复现:机器学习小微企业信用风险评估模型

SCIQ1金融顶刊复现:机器学习小微企业信用风险评估模型

标题

收录期刊Heliyon

论文概述

该论文有12页,Toby老师对此论文进行概述。

本研究通过机器学习技术,特别是在处理不平衡数据集和信用风险评估方面,为小微企业的信用风险管理提供了新的视角和工具。研究结果不仅在理论上有所贡献,也为实践界提供了有价值的参考。

论文数据集描述

Toby老师分析,这20个变量大多数是公司财务数据,20个变量有些偏少,经过变量筛选后,入模变量会更少。如果能保证15-20个变量入模,维度是合适的。数据量方面只有850个,对于金融数据,样本量偏少,我们重庆未来之智公司的企业信贷数据集有几十万条。从统计学角度,850个样本是足够的,这论文数据质量没有问题,收集的变量是核心变量。

论文配图解读

Toby老师认为该论文图片做的挺不错,让编辑对建模过程一目了然。

这张图片展示了一个关于小型和微型企业信用风险评估的研究流程图。流程图分为几个主要部分,具体如下:

整个流程图展示了从数据收集到最终信用评级的完整研究过程,以及在研究过程中使用的各种方法和工具。

论文多算法比较评价

我们选择前八个变量作为预测变量,而小微企业的信用度作为响应变量。对于我们的预测建模,我们采用了四种著名的机器学习算法,这些算法因其在信用评估方面的熟练程度而闻名:XGBoost、决策树、随机森林和支持向量机[47]。每个算法都使用贝叶斯优化进行微调,处理相同的特征子集。随机选择的75%原始数据集被指定用于训练模型,并应用SMOTE技术来解决数据不平衡问题。剩下的25%作为测试集,评估这些模型的性能。

下述四个算法AUC,accuracy,f1分数都很高,难免让人可疑。根据Toby老师多年经验,存在这三个指标接近1的情况可能是:

1.模型过度拟合:特别是非平衡数据处理不当时候可能导致

2.数据泄露:存在可疑变量,造成数据泄露,模型AUC接近1

3.数据质量非常好:Toby老师也见过少数真实数据集,这三值个接近1,这些数据一般是从商业数据库整合而来。

模型分数阈值评价

Toby老师点评一下,真正意义上信用评分卡是逻辑回归模型通过calibration技术转化而成,中间有复杂数据处理过程,包括变量分箱(卡方,kmean,决策树算法),WOE转换,预设p0,pd0等参数。XGBoost模型的信用评分卡这种叫法并不准确,xgboost是通过对原始数据建模,并没有通过分箱和WOE转换处理,但calibration技术可以实现。因此Toby老师认为作者描述XGBoost模型的信用评分卡会给读者带来认知误区,认为xgboost也能构建和逻辑回归一样评分卡模型。

作者设置650分可以有效分离大多数样本,说明作者在金融风控领域业务方可能有丰富工作经验或较深认知能力,Toby老师对其表示赞赏。设置分数阈值是业务方常用方法。

论文非平衡数据处理评价

该学生抽样从论文的非平衡数据处理来看,做了大量实验,包括过采样,欠采样,SMOTE技术。

Toby老师论文复现

我方重庆未来之智信息技术咨询服务有限公司有十几个企业信用风险数据集,下面展示一个经典企业信用风险的数据集,2023年数字中国创新大赛-金融大数据应用:企业信贷风险防控。

变量如下

数据可视化和探索性分析,我们可以发现target目标变量存在明显的非平衡数据情况,违约企业只占少数。之后我们会复现论文中SMOTE算法处理不平衡样本。

通过数据挖掘,我们发现数据集有多个强变量,例如预计未来一年贷款金额,征信评级,近一个月流水总额,客户评级,结清时长,是否提前结清。

Toby老师通过SMOTE算法适度增加逾期客户数量。

SMOTE(SyntheticMinorityOver-samplingTechnique)是一种流行的处理不平衡数据集的方法。它通过生成合成的少数类样本来平衡数据集,而不是简单地复制现有的少数类样本。以下是SMOTE算法的基本原理和步骤:

SMOTE算法的优势在于,它不仅可以简单地复制少数类样本,还可以生成新的样本,从而增加数据集中少数类的多样性。这有助于提高分类模型对少数类的识别和分类能力。然而,SMOTE也有其局限性,包括可能产生噪声数据、可能导致过拟合,以及对少数类样本分布的敏感性。

汇总

论文建模定制服务

《SCIQ1金融顶刊复现:机器学习小微企业信用风险评估模型》就为大家介绍到这里。重庆未来之智信息技术咨询服务有限公司专业从事AI机器学习建模,为国内外多家金融公司建立模型。公司客户包括国内诸多金融机构,银行,证券公司,科研所。

同时我们也为科研高端人群提供论文定制服务,包括毕业论文和学术论文。

THE END
1.CollaborationMicrosoftLearnExchange Online Exchange Server Dezvoltare Exchange Depanare Referin?e PowerShell Resurse Acest con?inut nu este disponibil ?n limba dvs. Iat? versiunea ?n limba englez?. ?ndep?rtare avertizare Versiune Exchange Server 2019 https://learn.microsoft.com/ro-ro/exchange/collaboration/collaboration
2.UserExperienceArchivesThe only difference is that the patient and doctor communicate online. Video conferencing solutions and remote health monitoring apps are the most popular tools that medical organizations use for delivering clinical services from a distance. But the concept is constantly evolving so there is a lot https://millermedia7.com/category/user-experience/
3.OMO(OnlinemergeOther solution from this provider Exclusive Freebie Success Cases:Venchi 如何運用 WhatsApp 於 VIP Week 達成 2 倍銷售增長余仁生零售數碼轉型:運用WhatsApp、手機App 就是 GMV 提升 10 倍的秘訣 Omnichat Limited Omnichannel CRM messaging integration https://ddiy.hkpc.org/index.php/en/node/753
4.OMO(OnlineMergeOffline)模式是指线上和来自英练帮OMO(Online-Merge-Offline)模式是指线上和线下相融合,是继O2O之后,利用科技发展带来线上线下快速融合,市场效率大幅提升的商业模式。 此概念2017年由创新工场创始人李开复提出,他指出“未来世界即将迎来OMO,https://weibo.com/6028818388/JmfFK3RCQ
5.OnlineMergeOffline(在线服务+线下体验)freedragonOMO模式全称为Online Merge Offline(在线服务+线下体验),是一种数字化+线下的混合营销运营模式。 具体实施步骤: 确定OMO战略目标,如客户积累、产品推广、线下转换率提升等。 开发OMO在线产品和服务平台,如App程序、微信小程序等。 在线平台内设计互动工具,如在线辅导、试用体验等,提前引导下线购买。 https://www.cnblogs.com/flyingsir/articles/17643742.html
6.MergePDFonlineWant to secure and merge PDF files on-the-go? You can also use the full Soda PDF Online application to convert from PDF and convert to PDF in any browser, on any device. It's FREE*! Work Offline Merge PDF files even without Internet access.Downloadand install the Soda PDF desktop apphttp://www.pdfmerge.com/
7.OMO是什么?线下业务多的企业如何做数字化转型,如何实现线上线下OMO(online merge offline)模式是以「消费者」为核心,将线上线下整合,这样做有助于在碎片化、以及线上线下界线模糊时代,整合顾客资料而描绘顾客轮廓,就能够更好地了解顾客行为和预测商机,并且提供全通路一致的客户服务。 这股OMO 趋势在Covid-19 疫情期间,推动许多拥有实体通路的零售品牌进行数位转型,然而在后疫情时https://www.linkflowtech.com/blogs/omo-cro-data-driven
8.OMO與O2O:新舊零售模式的演進與對比文章分享OMO(Online Merge Offline)和O2O(Online to Offline)是兩種代表性的零售模式,隨著科技的進步和消費者行為的變化,零售業的商業模式不斷地演進,而OMO和O2O各自反映了不同時期的市場需求和技術應用。 O2O(Online to Offline) O2O模式起源於21世紀初,當時的零售業正尋求將線上的流量轉化為線下實體店鋪的銷售。這種模式https://a1.digiwin.com/essay/essay-content.php?detail=1038
9.OMO是什麼?虛實整合怎麼做?2024年新零售趨勢與策略一次看懂OMO(online merge offline)模式是以「消費者」為核心,將線上線下整合,這樣做有助於在碎片化、以及線上線下界線模糊時代,整合顧客資料而描繪顧客輪廓,就能夠更好地了解顧客行為和預測商機,並且提供全通路一致的客戶服務。 想加速完成 OMO 虛實整合,歡迎與我們預約免費顧問:https://www.no8.io/contact https://blog.no8.io/omo
10.现有RAG框架非完全总结:7个GraphRAG+17个传统RAG框架归纳所以,即便是外面的形势一直在变,但我们总会有一些东西是不变的,例如,有很多现成的开源工具依旧在推,例如,在开源项目(https://www.wangrs.site/awesome-LLM-resourses)中,我们可以看到一些较好的RAG框架,目前有的,其实远不止这些。 按照目前RAG发展的态势,可以进一步将现有RAG框架分为7个GraphRAG框架以及17个传统https://zhuanlan.zhihu.com/p/12860894412
11.OMO是甚麼?新零售OMO方式指南:概念例子應用技巧全渠道OMO (Online Merge Offline / Offline Merge Online) 營銷模式是甚麼? OMO (Online Merge Offline / Offline Merge Online) 可說是O2O的升級版,OMO強調整合線上及線下的客戶資訊,透過這種整合,可以更精確地了解目標受眾的特徵和需求,並針對不同的消費族群提供個性化的銷售服務。 http://www.storeberry.ai/hk/blog/from-o2o-to-omo-boot-sales/
12.OMO教育模式是什么?为什么那么火?OMO(Online Merge Offline) OMO教育模式意味着将线上教学和线下教学相结合,打造完整的教育生态借助优路全国规模平台优势,结合互联网科技力量融合线上线下,打造全场景的教学模式。沉浸式的学习体验,结合大数据分析 针对性解决学习问题教育领域的OMO模式,是一种多场景融合、依靠技术力量进行大数据分析,线上线下深度融合、优https://www.keedu.cn/news/view?id=124683
13.HowtoMergePDFsOnlinewithSmallpdfMerger&AlternativesRead on to learn how to use Smallpdf to merge PDF files and some of the best alternatives you should consider using. Directory Part 1: How to Combine PDFs Online Using Smallpdf PDF Merger Part 2: What Are the Best Offline Alternative Mergers to Smallpdf? Alternative 1: Coolmuster PDF https://www.coolmuster.com/pdf/smallpdf-merge.html
14.42篇博文含有标签「BestPractice」a time series database. Data flowed into a Kafka message queue. After the fields were parsed and cleaned, they arrived in InfluxDB, ready to be queried. InfluxDB responded to both online and offline queries. The former was to generate metric monitoring reports and bills in real time, and https://doris.apache.org/zh-CN/blog/tags/best-practice/
15.MergePDFFreeOnlinePDFCombinerPDFProMerge PDF online for free with PDF Pro's online PDF merger tool! Free to use, safe, and reliable.https://pdfpro.com/merge-pdf/
16.MergePDFCombinePDFFilesOnlinewithFreePDFMergerHow To Merge PDF How To Add Pages to a PDF & Combine PDFs Online Looking for an easy way to add pages to a PDF, or merge multiple PDFs into one? Here are the best online and offline options you can use for free. How To Merge PDF How to Merge PDF Files with Adobe Reader Guidehttps://smallpdf.com/merge-pdf
17.MergePDFFilesOnlineMerge PDF Files Online. Combine multiple PDFs and images into one. Online, no installation or registration required. It's free, quick and easy to use.https://www.sejda.com/merge-pdf
18.HowtomergePDFfilesoffline:EasilycombinemultiplePDFsHow to merge PDF files offline with iLovePDF Desktop In this section, we'll walk you through the step-by-step process of merging PDF files using theiLovePDF Desktop App. While the onlinemergetool provides quick convenience, the Desktop App takes it a step further, offering offline PDF merghttps://www.ilovepdf.com/blog/merge-pdf-offline
19.PDFCombinerCombineandMergePDFFilesOnlineforFreeIf you are looking for a way to combine and merge pdf files online, try PDFChef– a free pdf combiner! ? This simple web-based tool lets you merge PDF files with no limits and no watermarks added.https://pdfchef.com/merge-pdf.html
20.HowtoensureyouronlineactivismhasanofflineimpactUltimately, digital tools available today can continue to build a new wave of promising activism when the offline and online merge. "Even when the path is not paved for them, people can resist. People can demand to be heard," Jackson says. "The hero isn't the technology. The heroes arehttps://mashable.com/article/activism-on-social-media
21.anunifiedschedulerforonlineandofflinetasksYuquan RenMerge pull request #56 from binacs/dev/bin6111fc012天前 91 次提交 .github/workflows fix github action failure due to failing to create kind cluster 9个月前 LICENSES/vendor first commit for godel scheduler 1年前 cmd remove leader migration configuration https://portrait.gitee.com/kubewharf/godel-scheduler
22.Top11YouTubeVideoRippersOnline/Offline[2024]have listed down the best YouTube video rippers out there. Here are the top 11 YouTube video rippers you should try for offline and online convert and merge video files. If you want a quick access, you can install its extension and add to home screen. Like all the tools on thishttps://filmora.wondershare.com/youtube/free-youtube-video-rippers.html
23.M3U8Converter:HowtoConvertM3U8toMP4[Online/OfflineEdit M3U8(TS) video before converting to MP4. You can cut, crop, merge video or apply effects, etc. Download online videos from YouTube, Netflix, Facebook, and other 1000 sites. The toolbox includes Fix Metadata, CD/DVD burner, GIF Maker, Screen Recorder, Video Compressor. https://videoconverter.iskysoft.com/convert-mp4/convert-m3u8-to-mp4.html
24.DistinctonlineandofflineeffectsofalphaandbetaDistinct online and offline effects of alpha and beta transcranial alternating current stimulation (tACS) on continuous bimanual performance and task-setAmplitude characteristics in the beta band merge with increasing performance speed, impeding the differentiation between de- and re-synchronization20,72https://www.nature.com/articles/s41598-019-39900-0
25.New:CollaborateOnlineandOfflinewithOverleafandGitYou just have to git pull the changes from Overleaf before you can git push your changes to Overleaf. If there are any merge conflicts, you'One you've pushed your changes, they'll automatically appear online! Using Graphical Git Clients The Overleaf git bridge is also compatible with graphttp://www.overleaf.com/blog/195-new-collaborate-online-and-offline-with-overleaf-and-git-beta
26.MergeDTS:AMethodforEffectiveLargeThe effectiveness (regret) and efficiency (time complexity) of MergeDTS are extensively evaluated using examples from the domain of online evaluation Clarke CDiaz FArabzadeh NChua TLauw HSi LTerzi ETsaparas P(2023)Preference-Based Offline EvaluationProceedings of the Sixteenth ACM International Confhttps://dl.acm.org/doi/10.1145/3411753
27.5EasyWaystoMergePDFFiles:Online,PC,&MacLearn free and easy ways to merge PDF files online or on your computer.Combining the contents of two or more PDF files is easy, even if you don't have Adobe Acrobat. Many free apps are capable of merging PDF files together. You can do ithttps://www.wikihow.com/Merge-PDF-Files
28.5+FreeResizePDFEditors(Online&Offline)WPSOfficeBlogResizing PDF is a common operation in life. When it comes to sharing, uploading, printing, archiving, or storing PDFs, resizing them becomes essential. With a plethora of PDF resizers available online, it can be overwhelming to choose the right tool for the job. In this article, we aim https://www.wps.com/blog/5-free-resize-pdf-editors-online-and-offline/
29.FrontiersComparisonofCNNFinally, the authors ofDiaz et al. (2019)were able to merge the online and offline handwriting approaches by incorporating dynamic information into static images. This approach seemed to improve classification in cases where the task can be performed continuously without lifting the pen. The highesthttps://www.frontiersin.org/article/10.3389/fninf.2022.877139/full
30.KraftHeinzAsiaCMO:Asecommercegrows,profitabilitymustKraft Heinz' Amin said the ability to use mobile data to link offline experience with online purchases has huge applications for marketers. "How do you merge offline brand experiences and the purchase on mobile or on digital? I think that's really where this will start becoming vahttp://www.campaignasia.com/article/kraft-heinz-asia-cmo-as-ecommerce-grows-profitability-must-be-addressed/467942
31.GitHubAutomatically display online/offline indication to your users - HubSpot/offlinehttps://github.com/HubSpot/offline