j$U4dZddlmZddlZddlZddlZddlZddlZddlZ ddl Z ddl m Z m Z mZmZmZdddGd ZdddHdZdIdZdJdddKdZGddZdLd"Zd#d$dd$d%dMd)ZdNd*ZdOd+Zdd,ddd-dPd1ZGd2d3Z dQd$d4dRd?Zd@dAdBdSdFZdS)Ta Mesh cleanup, decimation, UV unwrapping and texture / vertex-colour inpainting. Results stay on the device of their inputs; decimation (fast-simplification, MIT), UV unwrapping (xatlas, MIT), connected components (scipy) and image inpainting (OpenCV) run on the CPU. ) annotationsN)Mesh face_normalsselect_verticessubmeshweld)min_areameshrr floatreturnc6|j}|dddf|dddfk|dddf|dddfkz|dddf|dddfkz}|t|j|dd|zkz}t ||S)z`Drops faces with a repeated vertex index or an area <= min_area, then the vertices no face uses.Nrrdim)facesrverticesnormr)r r rkeeps =C:\Users\johnn\OneDrive\Documents\AI\shared\mesh3d\cleanup.pyremove_degeneraters JE !!!Q$K5A; &5A;%1++E F%PQPQPQSTPT+Y^_`_`_`bc_cYdJd eDL . . 3 3 3 : :Q\ IID 4  ) tolerancercX|dkr.tjj|z nJjdztj}|gfddDz}tjtj|ddd\}}tj t||j }tj t|dzft||j d||d }tj|}tj t||j ||<||j} | d d df| d d dfk| d d df| d d d fkz| d d d f| d d dfkz} t'|j| | S) a<Merges vertices whose positions are equal (or round to the same multiple of tolerance) and whose normals, uvs and colours are identical, so UV seams and hard edges stay split; to weld through them, pass a Mesh without those attributes. The first vertex of each group is kept; faces that collapse are removed.rr cg|]f}t|t|dztjgS)Nr )getattrr viewtorchint32long).0kr s r z"merge_vertices.."sZZZWX}DEIKL}M}M}Y'$**0022S8>>u{KKPPRR}Y}Y}Yr)normalsuvscolorsrT)rreturn_inversedeviceaminNr)rroundrr!r rr uniquecatarangelenr*fullintmaxscatter_reduce empty_likeargsortrrsortvalues) r rpositionkeys_inverseorderfirstrankrrs ` rmerge_verticesr@s2AJA u{4=9455::<<z#_Worker.__init__..\s6V~V~kpWZ[^_d[e[eWfWfV~V~V~V~V~V~rCREATE_NO_WINDOWr)stdinstdoutstderr creationflagsc ^g}5D]n}|drBttt|dd_Y||o dddn #1swxYwYd|jd<dS)Ns UV_PROGRESS rrr}) startswithtuplemapr2splitprogressappendjoinoutput)errorslinereaderselfs r read_statusz%_Worker.__init__..read_statusdsF , ,",,D77,(-c#tzz||ABB7G.H.H(I(I  d++++ , , , , , , , , , , , , , , , , %(HHV$4$4DK ! ! !sA2BB  B T)targetdaemoncjdjd<dS)Nrr|)process communicategetvaluerr)payloadr status_threadsrrz%_Worker.__init__..communicateqsI$(L$<$.s!666A666r) rris_aliverr returncode RuntimeErrorrdecodestriprrrange)rrPrrreportedcurrentrs @rresultz_Worker.resultxs_  8#3 K      H+&&(( .*KMMM-'G,?GxDWDWHg&&&H    ---+&&(( .& < " pndk(6K6R6RZc6R6d6d6j6j6l6lnnoo o  DM$= Hdm $ $DK1226666u6666rc|j|j|jdSrw)rpollkillrrrs rrz _Worker.closesD <     & L      r)rrrs)rPr2rr)__name__ __module__ __qualname____doc__rpathrdirnameabspath__file__rrrrrrrrqrqNs22W\\"'//"'//(*C*CDDFV W WF""""H15t777777,rrqpoints np.ndarray triangles target_facesr2aggressivenesspartstuple[np.ndarray, np.ndarray]cddlm}ddlmm}fd||d}|t |5fd|D}d d d n #1swxYwYd |D} d |D} | D]} | n#| D]} | wxYwtjdgd | Dz} tj tj d | Ddd\} }| dtj dt| | D}||d d df|d d dfk|d d df|d d dfkz|d d df|d d dfkz}| | tjfS)a&The cells of a parts^3 grid decimated in parallel child processes, each to its share of target_faces with its cut border kept, then welded back on their unchanged border vertices. The cells are extracted and their processes started by parallel threads (the numpy work releases the GIL).r)ThreadPoolExecutorr) cell_mesh grid_partsc|\}}tt|ztz }td|f||tjfS)N decimate_cell)r,r0rqastyperMr ) groupusedlocalsharerrrrrs rrz_decimate_parts..startspi 599 elSZZ/#i..@AA(?&,PUP\P\]_]ePfPfAghhhrF)centersc<g|]}|Sr)submit)r"rpoolrs rr$z#_decimate_parts..s'@@@$++eU++@@@rNc^g|]*}||+Srw) exceptionrr"rrs rr$z#_decimate_parts..s-III1Hszz||1H1H1Hrc\g|])}|d*S)r)rrs rr$z#_decimate_parts..s.<<.s":::$!Qs1vv:::rcg|]\}}|Srrrs rr$z#_decimate_parts..s/F/F/Fda/F/F/FrT)axisr(rEc$g|] \\}}}||zSrr)r"r;foffsets rr$z#_decimate_parts..s$/g/g/g~v1vF /g/g/grr)concurrent.futuresr mesh_workerrrr0rrMcumsumr- concatenaterLziprr )rrrrrrrgroupsstartsworkersresultsworkeroffsetsweldedr<rrrrs```` @@@r_decimate_partsrs65555522222222iiiiiiiii Z 5% @ @ @F  CKK ( (AD@@@@@@@@AAAAAAAAAAAAAAAIIvIIIG< 1 first decimates the cells of a parts^3 grid in parallel child processes (their cut borders kept), then the welded result in a last pass: fast-simplification is single-threaded and keeps the GIL (16.9M faces to 100K: 46 s in one pass, about 20 s with parts=2, at the same distance to the input surface). Not available with vertex colours.rNrz1decimate(parts > 1) does not carry vertex coloursr)rT)r() target_countaggrreturn_collapsesr_r+r[)!fast_simplificationr0rr' ValueErrorrr*rr/rJrKrrMfloat64r r-r rsimplifyrrbrfrcint64replay_simplificationr1r4r zerosrF index_add_rd clamp_min)r rrrrrrr* positionsr<rrrr simplified points_out faces_outrr;mappingr>r'sumss rdecimaters 4:,&&  qyyT[,LMMM ] !F B$(M5<DM@R@R[a3b3b3bdhdnE7   5 5 7 7 > >rz J Jf!$-00 7 #uQQQT{eAAAqDk1eAAAqDkU111a4[6PQUZ[\[\[\^_[_U`dijkjkjkmnjndoUopql5>>> e4$$&&,,..55bjAA !!##**2844I qyy+FI|^]bcc $--fil`nAP?C{RV?V.XXJ&rrNJ %":#4#4RZ#@#@AADDVLLeN^_h_o_oprpx_y_yNzNzN}N}EOFOFGGF {+AA&--PRPZB[B[]fhrsthuvv 1g"7>>"(#;#;<<??GG C NN,c'll%+V\]]]$$Qc'llSY1Z1Z1Z\bcc""$$U4[1{3z??FLOFKKKVVWXZacijju~gZQQQ[[\]^^_`_`_`bf_fgg Mrc |jj}t|tj|t j|tj|t j dd|}| tj||dddS)NrEr])r& base_colormetallic_roughness normal_map) rr*rrrbrrMrrcrLr)r rindicesr&r* unwrappeds r _atlas_meshrs ] !Fe&6w~~bh7O7O&P&P&S&STZ&[&[]b]mnun|n|}~FoGoGoOoOPRTUoVoV^W^W^Z^Z[a^b^bccI   !1#!6!6!9!9&!A!Adgkx|  } }}rc0|j|jtjfSrw) rdetachr rJrKrrrMuint32)r s r_xatlas_arraysrsi =   ! ! ' ' ) ) - - / / 5 5 7 79I9I9O9O9Q9Q9X9XY[Yb9c9c ccrr) resolutionpaddingmax_iterationsrrrrc ^ddlm}t|g|gt|||||RRS)aUV atlas from xatlas: a Mesh whose vertices are split along the chart seams (faces keep their order), with uvs in [0, 1] (glTF convention, see mesh.py). Normals and colours follow their vertices; textures are dropped (they belong to the old uvs). For good charts, weld first (merge_vertices on a Mesh without uvs) and decimate large meshes before unwrapping. resolution > 0 packs for that texture size with `padding` texels between charts. xatlas is CPU code whose chart computation grows faster than the mesh: parts > 1 unwraps the cells of a parts^3 grid as separate xatlas meshes, computed in parallel (100K faces: 26-46 s whole, under 2 s with parts=2), with slightly longer seams; BackgroundUnwrap runs it in a child process.r) unwrap_arrays)rr rr)r rrrrr s r unwrap_uvr!sZ+***** t ommn^D-A-An:nwnXfnhmnnn o o oorc>eZdZdZddddddddZdddddZdZdS)BackgroundUnwrapaunwrap_uv(mesh, ...) computed in a child process (mesh_worker.py), so that it overlaps other work: xatlas keeps the GIL while it runs, which would stall the kernel launches of a thread. result() returns the same Mesh as unwrap_uv; close() stops the process (call it on cancellation). max_faces bounds spatial regions instead of using a fixed grid; this path reports progress and uses get_default_workers() for its CPU budget. result(progress=True) displays completed regions plus the final atlas packing.rrrN)rrrr max_facesr rrr2rrrr$ int | Nonec ||_|)td||||ft||_dSddlm}td||||t dt|ft||_dS)Nunwrapr)get_default_workersunwrap_boundedr)r rqrrshared.utils.utilsr(r3r2)rr rrrrr$r(s rrzBackgroundUnwrap.__init__s  !(Z.RW,XZhimZnZnooDKKK > > > > > >!"2Z.ZcehijloqDqDqFqFmGmGfHfH5IKYZ^K_K_``DKKKrFrrc  ddlm}ddlm ddlm|5dx fd}t |jg|jd||r|ndRcdddS#1swxYwYdS) zwWait for the atlas, polling the caller's cancellation check when supplied. Close in a finally block to reap the worker.r) ExitStack)tqdm) PhaseProgressNc^|rdnd}B||dd||dj|kr||_|jz |jz dS)NzPacking UV AtlaszUnwrapping UVsstepsgUUUUUU?)totaldescunit mininterval) enter_contexttitleset_descriptionupdatenadvance completed) r;r1packingr6r.barphasestackr-s rr8z'BackgroundUnwrap.result..update s.5K**;K;--ddUQXfk.l.l.lmmC!// eUG0T0TUUE;%''''..."'EK 9su,--- i%/9:::::rr]r) contextlibr,r-shared.utils.phase_progressr.rr rr) rrrr,r8r.r=r>r?r-s @@@@@rrzBackgroundUnwrap.resultsA((((((====== Y[[ BE C% ; ; ; ; ; ; ; ; ;tyB4;+=+=a[muccici{+=,A,ABBB B B B B B B B B B B B B B B B B B Bs>A--A14A1c8|jdSrw)rrrs rrzBackgroundUnwrap.closes r) r rrr2rr2rr2rr2r$r%)rr)rrrrrrrrrrr#r#s@@ 9:!cdst)-``````%)5BBBBBB.rr#)flip_vtexture torch.Tensormaskvtx_posvtx_uvpos_idxuv_idxtorch.Tensor | NonerC!tuple[torch.Tensor, torch.Tensor]c |j|jc}\}} } ||n|}|} tj|rd| dddfz n | dddf|dz z} tj| dddf| dz z} |d|d}}| || z| |z}|d|dk}tjt||}t|}|d| }tj |fdtj | d||||d}|dk}tj || tj |}||||||<tj|||}|dk}|d|ddd}}||||z d d d }d \}}|dkr|||z}tj |tj |d||} tj || tj |d||dddf||z}!|| dkz}"tj|"dddf|!| d dddfz |}||"z}t-|||"z}#||#|krdndz }|#}|dk||}$tj || zfdtj | d||$||$d}%|%dk}&||}(}'|||%|&})|jtjkr@|)dd|jn|)|j|'d| |&<|jtjkrdnd|(d|&<|'|(fS)aFills texels at the mesh's UV corners from the colours of neighbouring vertices: a vectorized, behaviour-compatible reimplementation of the "smooth" mode of Hunyuan3D's meshVerticeInpaint (written independently, no Tencent code). texture [H, W, C] (float or uint8) and mask [H, W] (> 0 = painted) are images whose rows run top to bottom; vertex positions vtx_pos [P, 3] with faces pos_idx [F, 3], uvs vtx_uv [T, 2] with faces uv_idx [F, 3] (default pos_idx). The texel of a uv is (round(v * (H - 1)), round(u * (W - 1))) with v = 1 - v when flip_v (the reference uses OpenGL uvs, i.e. flip_v=True; WanGP meshes use glTF uvs, flip_v=False). 1. A vertex whose corner texel is painted takes its colour (the last such corner in face order). 2. Vertices with an unpainted corner are then repeatedly set to the inverse-squared-distance weighted mean of their coloured neighbours (each corner's next corner in its face), until no more vertices can be reached, plus as many further smoothing passes as the reference's termination rule gives. Unlike the reference, which updates vertices in place one after the other, each pass updates all vertices at once (order independent), so colours can differ slightly where several passes propagate. 3. Every corner of a coloured vertex writes its vertex colour into its texel (the last corner wins) and marks it in the mask (255, or True for a bool mask). Returns the new texture and mask on the input device.NrrrEr)r_rar[rg-C6?)rrgKH9T)r*rFdoublerr,r!rLr/r0r1rr4rrfr rdrollrr powrwherer2sumcloner`uint8clamprcrr)*rDrFrGrHrIrJrCr*heightwidthchannelsr&rQrR corner_vertex corner_uvtexelpaintedr=rflatlastcoloredcolorentriespendingsourcerweightbudgetpreviousactiver1rr8missingwritewinnerwritten new_texturenew_maskr8s* rinpaint_vertex_colorsrpsY$)0 %F %VUHWWFF --//C ;6@SAYs111a4yVaZP Q Q V V X XD ;s111a4yEAI. / / 4 4 6 6D&r2277996>>";M;M;R;R;T;T9M Oe #d9o 5Ell2u%)G LUF 3 3 3E7||H ??2x ( (D :xk2U[ H H H W WXY[hip[qsxzAtBDJ K KDaiG K(%- O O OE%W ./5577E'Nn]G84IIIGkG__R((--//b!1D1D1L1LR1P1P1U1U1W1WFFfo$$&&)?)?)A)AA G GA G N N X XY] ^ ^ b bce f f l l n nFFH 1**'&/) HEM&IIITTUVX^`fgg{8XU]6RRR]]^_agiopqpqpqswpwix|ABH|IjIJJEAI& F111d7OTEOOE4J4J111d74S-SUZ[[6gg/04466778++""2 1** M "E Z%)2U[ P P P _ _`achincoqvw|q}@FGGFkG#MMOOTZZ\\K =1 2F`g`mqvq|`|`|fllnn.B.B1c.J.J.M.Mgm.\.\.\CICLCLMTMZC[C[KR""7+)-uz)A)AsHMM"g   rg@ns)radiusmethodrrrsrsc ddljjd| |}|jt jkr|nY|dz dd t j }| dk tj |jddkr|dddf|dddfgn|g} fd |D}t jtj|d |j}|jt jkr|n.|dz |jS) aaFills the texels where mask > 0 with OpenCV inpainting (method "ns": Navier-Stokes, as Hunyuan3D; "telea"), on the CPU. texture [H, W, C] uint8 or float 0..1 (C = 1, 3 or 4; alpha is inpainted separately); returns the same dtype on the input device. Note: mask marks the texels to fill (OpenCV convention), i.e. the complement of a painted mask.rN)rqtelearOr.r]c ~g|]9}tj|j|j:Sr)inpaintrMascontiguousarrayrLrF)r"gcv2flagsholesrrs rr$z#inpaint_texture..bsF k k k_`Pckk".q115&%HHPRSRYZ k k kr)r{ INPAINT_NS INPAINT_TELEArrJr`rrVr r,rWrcrKrrMrFrbrr*) rDrFrrrsrrfilledrr{r|r}s ` @@@rinpaint_texturerXsJJJ>C,= > >v FE NN   " "EkU[00UUu{{}}s7J6Q6Q6S6S6Y6YZ[]`6a6a6d6dejep6q6q x x z zE [[]]   & & ( (1 , 4 4RX > >E16Q11D1DeC!GneCGn - -5'F k k k k k k kdj k k kF  bnVQ77 8 8 ; ;GN K KF]ek1166 8L7P7PQXQ^7_7__r)r rr r rr)r rrr rr)r rrrA)rW)r rrYr rXr rr) rrrrrr2rr rr2rr)r rrr2rr rrrr2rrrr)r rrr)r rrr) r rrr2rr2rr2rr2rrrw)rDrErFrErGrErHrErIrErJrKrCrrrL) rDrErFrErrr rsrsrrE)r __future__rrrrrrrKrMrr rrrrr rr@rVrorqrrrrr!r#rprrrrrs #"""""   DDDDDDDDDDDDDD8;69 C C C C C C + + + +']`''''''(CCCCCCCCL****8HKdixy!))))))X~~~~ dddd01Z[jkpppppp''''''''V9=:!PU:!:!:!:!:!:!zSVei ` ` ` ` ` ` ` `r